Senior Software Engineer, Machine Learning Inference

Nvidia Corporation

CA, United States
Base: 152,000 usd - 241,500 usd (level 3) or 184,0...
**
Design and optimize tensorrt and tensorrt-llm
Develop software in c++, python, and cuda
Collaborate with deep learning experts and gpu architects
** NVIDIA is seeking a Senior Software Engineer to join their TensorRT team, focusing on the development of deep learning inference software for NVIDIA AI accelerators. The role requires strong programming skills, particularly in C++, along with experience in deep learning frameworks and a collaborative mindset to work on cutting-edge AI applications. **

Job Summary

  • Design, develop and optimize NVIDIA TensorRT and TensorRT-LLM to supercharge inference applications for datacenter, workstations, and PCs.
  • Develop software in C++, Python, and CUDA for seamless and efficient deployment of state-of-the-art LLMs and Generative AI models.
  • Collaborate with deep learning experts and GPU architects throughout the company to influence Hardware and Software design for inference.

Matching Summary

Match Score: 75

** NVIDIA is seeking a Senior Software Engineer to join their TensorRT team, focusing on the development of deep learning inference software for NVIDIA AI accelerators. The role requires strong programming skills, particularly in C++, along with experience in deep learning frameworks and a collaborative mindset to work on cutting-edge AI applications. **

Salary

Base: 152,000 USD - 241,500 USD (Level 3) or 184,000 USD - 287,500 USD (Level 4); Equity: Eligible; Benefits: Eligible

Skills & Requirements

Must-have

  • Design and optimize TensorRT and TensorRT-LLM
  • Develop software in C++, Python, and CUDA
  • Collaborate with deep learning experts and GPU architects

Nice-to-have

  • Experience with LLM inference frameworks
  • Knowledge of close-to-metal performance analysis
  • Passion to learn and work effectively

Key Requirements

  • BS, MS, PhD or equivalent experience
  • 4+ years of software development experience
  • Strong proficiency in C++
  • Experience in developing Deep Learning Frameworks, Compilers, or System Software

Work Rights

Not specified

Tailored Resume

Cover Letter