Senior Software Engineer, Ai Inference Systems

NVIDIA

Base: 170,000 cad - 220,000 cad (level 4); base: 2...
Hybrid
7+ years software engineering experience
Python and c/c++ programming proficiency
Gpu kernel optimization and cuda expertise
This role involves architecting and implementing high-performance inference stacks to serve large-scale AI models with extreme efficiency

Job Summary

  • This role involves architecting and implementing high-performance inference stacks to serve large-scale AI models with extreme efficiency.
  • Candidates will collaborate across multiple teams to optimize GPU kernels, drive industry benchmarks, and scale workloads across multi-cloud environments.
  • The position offers the opportunity to conduct original research and publish findings that push the frontier of ML Systems and accelerated computing.

Matching Summary

Match Score: 75

This role involves architecting and implementing high-performance inference stacks to serve large-scale AI models with extreme efficiency.

Salary

Base: 170,000 CAD - 220,000 CAD (Level 4); Base: 225,000 CAD - 275,000 CAD (Level 5); Equity and benefits included

Skills & Requirements

Must-have

  • 7+ years software engineering experience
  • Python and C/C++ programming proficiency
  • GPU kernel optimization and CUDA expertise
  • Distributed systems and parallel programming knowledge
  • Deep learning theory and ML framework experience

Nice-to-have

  • Experience with Go or Rust programming languages
  • Contributions to open-source projects or publications
  • Familiarity with cloud platforms like AWS or Azure
  • Hands-on work with ML compilers and DSLs
  • Experience with containerization technologies

Key Requirements

  • Bachelor's degree in CS/CE/SE with 7+ years experience
  • Master's degree in CS/CE/SE with 5+ years experience
  • PhD with thesis and top-tier publications in ML Systems
  • Strong background in computer architecture and operating systems

Work Rights

Not specified

Tailored Resume

Cover Letter