Senior Software Engineer, Ai Inference

NVIDIA

Base: 135,000 - 185,000 cad (level 3) or 170,000 -...
Hybrid
5+ years industry experience building production-grade systems
Hands-on llm inference deployment with vllm
Proficiency in kubernetes and slurm orchestration
This role involves partnering directly with demanding customers to unlock the full performance potential of NVIDIA's inference stack

Job Summary

  • This role involves partnering directly with demanding customers to unlock the full performance potential of NVIDIA's inference stack.
  • Engineers will design end-to-end benchmarking campaigns across Kubernetes and Slurm environments to surface actionable insights for LLM serving.
  • The position offers competitive salaries ranging from 135,000 CAD to 220,000 CAD depending on level, along with equity and comprehensive benefits.

Matching Summary

This role involves partnering directly with demanding customers to unlock the full performance potential of NVIDIA's inference stack.

Salary

Base: 135,000 - 185,000 CAD (Level 3) or 170,000 - 220,000 CAD (Level 4); Bonus/Equity: Eligible for equity; Benefits: Comprehensive benefits package included

Skills & Requirements

Must-have

  • 5+ years industry experience building production-grade systems
  • Hands-on LLM inference deployment with vLLM
  • Proficiency in Kubernetes and Slurm orchestration
  • Deep understanding of GPU performance profiling tools
  • Experience with batching strategies and KV cache management

Nice-to-have

  • Contributions to open-source ML projects like vLLM or SGLang
  • Experience with NVIDIA Dynamo or disaggregated frameworks
  • Background in ML compilers or GPU kernel development
  • Prior customer-facing or forward-deployed engineering roles
  • Experience building developer tools for team productivity

Key Requirements

  • Bachelor's, Master's, or PhD in Computer Science or equivalent
  • 5+ years of industry experience in complex software systems
  • Strong written and verbal communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter