Principal Software Engineer, Tensorrt-llm

Invidia

Multiple Locations
Base: 272,000 usd - 431,250 usd; bonus/equity: not...
Hybrid
15+ years software development experience
Excellent python or c/c++ skills
Experience with llm inference frameworks
NVIDIA is building foundational AI serving software for its product lines

Job Summary

  • NVIDIA is building foundational AI serving software for its product lines.
  • The role involves architecting robust inferencing software for multiple platforms.
  • Contributing to state-of-the-art AI and compute systems is a key aspect of the job.

Matching Summary

NVIDIA is building foundational AI serving software for its product lines.

Salary

Base: 272,000 USD - 431,250 USD; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • 15+ years software development experience
  • Excellent Python or C/C++ skills
  • Experience with LLM inference frameworks

Nice-to-have

  • Strong understanding of GenAI serving
  • Excellent interpersonal skills
  • Ability to work in fast-paced environments

Key Requirements

  • Bachelors or higher degree in relevant field
  • 2+ years in architect/tech lead role
  • Experience with deep learning frameworks

Work Rights

Not specified

Tailored Resume

Cover Letter