Role: Data Engineer
Location & work model: Toronto, ON - Hybrid (2-3 days onsite per week)
Duration: 5 Months
Qualifications
- Proven experience with cloud storage solutions, specifically Amazon S3.
- Solid expertise in data processing frameworks such as AWS Glue and Apache Spark.
- Hands-on experience with real-time data streaming technologies, particularly Apache Kafka.
- Proficiency in data warehousing solutions, especially Amazon Redshift.
- Experience with workflow orchestration tools like AWS Step Functions and Apache Airflow.
- Skilled in querying large datasets using Amazon Athena.
- Solid understanding of data security and access management using AWS IAM and Lake Formation.
- Demonstrated ability in developing and maintaining data ingestion pipelines.
- Strong focus on data quality assurance and performance tuning of data workflows.
- Knowledge of data governance best practice...