Senior Performance Engineer - Deep Learning

Invidia

Us, CA, United States
Base: 152,000 usd - 241,500 usd for level 3; 184,0...
C++ and python programming
Parallel systems programming on gpus
Deep learning model performance optimization
Our team builds optimizations directly into mainstream open source Deep Learning frameworks to boost performance across NVIDIA's AI stack

Job Summary

  • Our team builds optimizations directly into mainstream open source Deep Learning frameworks to boost performance across NVIDIA's AI stack.
  • You will build and support the Transformer Engine library to accelerate training of Large Language Models and collaborate on systems research to improve model performance.
  • The role includes engaging with the open-source community, supporting enterprise customers, and influencing the design of new hardware and software components.

Matching Summary

Our team builds optimizations directly into mainstream open source Deep Learning frameworks to boost performance across NVIDIA's AI stack.

Salary

Base: 152,000 USD - 241,500 USD for Level 3; 184,000 USD - 287,500 USD for Level 4; Bonus/Equity: Eligible; Benefits: Eligible

Skills & Requirements

Must-have

  • C++ and Python programming
  • parallel systems programming on GPUs
  • Deep Learning model performance optimization
  • Transformer Engine development
  • collaboration with open-source community

Nice-to-have

  • experience with PyTorch or JAX
  • performance analysis and profiling
  • knowledge of LLM architectures and attention mechanisms
  • GPU kernel programming with CUDA or similar
  • open source contributions
  • multidisciplinary team collaboration

Key Requirements

  • BS or equivalent experience in Computer Science or related field
  • 3+ years experience in C++ and Python
  • strong background in parallel systems programming
  • knowledge of Computer Architecture and Code Optimization
  • experience developing large software projects
  • excellent communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter