Senior Software Engineer – Tensorrt Edge-llm

Nvidia Corporation

Multiple Locations
Base: 152,000 usd - 241,500 usd (level 3); 184,000...
On-site
Modern c++ development
Transformer model inference optimization
Cuda kernel development
Nvidia Corporation is seeking a Senior Software Engineer for its TensorRT Edge-LLM team, focused on advancing real-time large language model inference for edge AI applications in automotive and robotics. The ideal candidate should be proficient in modern C++, have a strong background in transformer models and inference optimization, and possess experience collaborating on high-performance software solutions

Job Summary

  • Develop and evolve a state-of-the-art inference framework in modern C++ that extends TensorRT with autoregressive model serving capabilities.
  • Design and implement compiler and runtime optimizations tailored for transformer-based models running on constrained, real-time platforms.
  • Collaborate with teams across CUDA, kernel libraries, compilers, and robotics to deliver high-performance, production-ready solutions.

Matching Summary

Match Score: 85

Nvidia Corporation is seeking a Senior Software Engineer for its TensorRT Edge-LLM team, focused on advancing real-time large language model inference for edge AI applications in automotive and robotics. The ideal candidate should be proficient in modern C++, have a strong background in transformer models and inference optimization, and possess experience collaborating on high-performance software solutions.

Salary

Base: 152,000 USD - 241,500 USD (Level 3); 184,000 USD - 287,500 USD (Level 4); Bonus/Equity: Equity; Benefits: Benefits

Skills & Requirements

Must-have

  • Modern C++ development
  • Transformer model inference optimization
  • CUDA kernel development
  • LLM framework familiarity

Nice-to-have

  • Open-source LLM contributions
  • GPU architecture fundamentals
  • Robotics or embedded AI pipelines

Key Requirements

  • 4+ years of software development experience
  • BS, MS, PhD, or equivalent experience
  • Deep understanding of transformer models
  • Proficient in modern C++

Work Rights

Not specified

Tailored Resume

Cover Letter