GCP Data Architect - lethbridge, Lethbridge

We are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly BigQuery, PySpark, and Dataflow, to design, build, and optimize scalable data pipelines. The role involves working closely with analytics, product, and engineering teams to ensure reliable data availability and performance. ???? Key Responsibilities - Data pipeline development: Design, implement, and maintain ETL/ELT pipelines using GCP services (Dataflow, BigQuery, Pub/Sub, Cloud Storage). - BigQuery optimization: Develop effective SQL queries, optimize schema design, and manage partitioned and clustered tables. - PySpark processing: Build scalable batch and streaming jobs for large datasets. - Dataflow orchestration: Implement real-time and batch data processing pipelines. - Data quality assurance: Ensure accuracy, consistency, and reliability of data across systems. - Collaboration: Work with data scientists, analysts, and business stakeholders to deliver actionable insights. - Documentation: Maintain clear technical documentation for pipelines, workflows, and data models. Apply on Kit Job: kitjob.ca/job/2owfp6