Senior Engineer-Cloud AI Infrastructure (Markham)

Huawei Canada has an immediate permanent opening for a Senior Engineer. Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting productization and iterative optimization of its technical achievements.Current research areas include cloud native databases, intelligent SQL engine, AI/Agent infrastructure and LLM/Agent Evaluation Technology. The lab fosters a robust technical setting, allowing collaboration with industry experts to create a highly competitive cloud platform. Join a cutting-edge team building next-generation infrastructure for AI and agentic workloads, sitting at the intersection of research, systems engineering, and product innovation. Responsibilities Track and analyze the latest trends in LLMs, agentic AI, and multi‑step agent workflows to inform infrastructure direction. Investigate and address infrastructure bottlenecks across GPU/NPU utilization, data movement, memory hierarchy, and distributed execution. Evaluate AI/agent workload requirements on cloud and hybrid infrastructure, balancing trade‑offs across cost, performance, and scalability. Deep dive into the full infrastructure stack — from distributed schedulers and inference pipelines to caching and data access patterns. Translate emerging AI trends and workload patterns into scalable, impactful infrastructure designs. Qualifications Solid foundation in distributed systems, cloud infrastructure, or systems engineering, with hands‑on experience building or operating large‑scale systems. Practical experience with AI/ML systems — whether in training pipelines, inference infrastructure, or both. Robust programming skills in low‑level or systems‑oriented languages such as Go or C++. Familiarity with LLM serving frameworks (e.g., A research-oriented mindset. Research‑oriented mindset — comfortable reading papers, running experiments, and prototyping ideas to validate architectural decisions. Sharp analytical and problem‑solving skills, with the ability to model workloads, identify performance bottlenecks, and propose principled solutions. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs. We do not use artificial intelligence tools. Apply on Kit Job: kitjob.ca/job/2prjgr