Software Engineer, Machine Learning Inference - New College Grad 2026

NVIDIA

Base: 108,000 usd - 195,500 usd; bonus/equity: not...
Hybrid
Tensorrt and tensorrt-llm development
C++ programming language
Deep learning frameworks development
NVIDIA is seeking a Software Engineer for its TensorRT team who will focus on developing deep learning inference software. The ideal candidate should possess strong programming skills, particularly in C++, and have experience in machine learning frameworks, while thriving in a collaborative and innovative environment

Job Summary

  • Design, develop and optimize NVIDIA TensorRT and TensorRT-LLM to supercharge inference applications for datacenter, workstations, and PCs.
  • Develop software in C++, Python, and CUDA for seamless and efficient deployment of state-of-the-art LLMs and Generative AI models.
  • Collaborate with deep learning experts and GPU architects throughout the company to influence Hardware and Software design for inference.

Matching Summary

Match Score: 85

NVIDIA is seeking a Software Engineer for its TensorRT team who will focus on developing deep learning inference software. The ideal candidate should possess strong programming skills, particularly in C++, and have experience in machine learning frameworks, while thriving in a collaborative and innovative environment.

Salary

Base: 108,000 USD - 195,500 USD; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • TensorRT and TensorRT-LLM development
  • C++ programming language
  • Deep Learning Frameworks development
  • System Software development
  • GPU programming with CUDA

Nice-to-have

  • Rust or Python programming
  • LLM inference frameworks experience
  • close-to-metal performance analysis
  • creative, autonomous, love a challenge

Key Requirements

  • BS, MS, PhD or equivalent experience
  • Software development experience on large codebase
  • Strong proficiency in C++
  • Excellent problem-solving skills
  • Strong communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter