Senior Software Engineer - Ai Inference

Nvidia Corporation

Base: 152,000 usd - 241,500 usd for level 3; bonus...
Not specified (considering the nature of the work, it may lean towards hybrid or onsite).
5+ years production software experience
Strong programming skills in python
Experience with llm inference stacks
NVIDIA is seeking a Senior Software Engineer specializing in AI inference to enhance open-source LLM serving and optimize inference engines for better performance on NVIDIA GPUs. The role requires strong programming skills, experience in LLM inference stacks, and a collaborative mindset

Job Summary

  • NVIDIA is a leader in AI-powered applications and technologies.
  • The role focuses on optimizing inference engines for NVIDIA GPUs.
  • Candidates will work in a collaborative environment with a diverse team.

Matching Summary

Match Score: 85

NVIDIA is seeking a Senior Software Engineer specializing in AI inference to enhance open-source LLM serving and optimize inference engines for better performance on NVIDIA GPUs. The role requires strong programming skills, experience in LLM inference stacks, and a collaborative mindset.

Salary

Base: 152,000 USD - 241,500 USD for Level 3; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • 5+ years production software experience
  • Strong programming skills in Python
  • Experience with LLM inference stacks

Nice-to-have

  • Open-source contributions
  • Experience building benchmarking infrastructure
  • Strong communication skills

Key Requirements

  • BS/MS in Computer Science or related field
  • Experience with profiling and performance investigation
  • Familiarity with distributed systems concepts

Work Rights

Not specified

Tailored Resume

Cover Letter