Canada

Data Engineer - Minimum 12+ years experience (Sherbrooke)

Data Engineer - Minimum 12+ years experience (Sherbrooke)
Description

Lead the migration from Glue/Redshift to Databricks


10+ years of professional data engineering experience, with at least 2+ years in a tech-lead or lead engineer capacity.

5-6 years of experience in each of the following areas:

Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file sizing).

Hands-on production experience with Databricks — Delta Lake, Unity Catalog, Workflows, and either Delta Live Tables or a comparable declarative pipeline framework.

Strong production experience with AWS Glue (jobs, crawlers, Data Catalog, triggers) and Amazon Redshift(including Redshift Spectrum, workload management, distribution and sort keys, performance tuning, and Redshift SQL / stored procedures).

Proven experience leading at least one substantial data platform migration or re-platforming effort end-to-end.

Expert SQL skills and robust software-engineering fundamentals: Python, version control, testing, and CI/CD.

Deep knowledge of AWS data services (S3, IAM, KMS, VPC, Lambda, Step Functions, MSK/Kinesis, CloudWatch).

Strong understanding of data modeling for analytics (dimensional, Data Vault, or medallion patterns) and lakehouse architecture.

Excellent communication skills; able to translate between executive stakeholders and engineers, and to write clear design docs and migration plans.

Apply on Kit Job: kitjob.ca/job/2on2lb
Highlights
Safety Tips
Do not pay a ’prospective employer’ anything in order to secure a job.
1 / 10
More info about this ad

Data Engineer - Minimum 12+ years experience (Sherbrooke) has been posted in the Sherbrooke Information Technology category on Locanto.

For Sherbrooke, there are no other ads posted in this category.

There are more ads within a 15 km radius for this category. If you want to view those ads, click here.