Deep Learning Architect, Llm Inference - New College Grad 2026

NVIDIA

Base: 124,000 usd - 195,500 usd (level 2); 152,000...
Not specified
Deep learning inference serving
Pytorch programming
Profiling and compiler optimizations
NVIDIA is seeking a Deep Learning Architect for LLM Inference, targeting new college graduates from the class of 2026. The role involves optimizing inference server performance for large language models and requires a strong background in deep learning, programming, and collaboration within a fast-paced environment

Job Summary

  • NVIDIA is at the forefront of the generative AI revolution, focusing on inference server performance optimization for Large Language Models (LLMs).
  • Responsibilities include workload characterization of LLMs and inference servers, collaborating with startups on benchmarking, and developing profiling tools.
  • The role requires a Master's or PhD degree, software development experience, and detailed knowledge of deep learning inference serving and GPU microarchitecture.

Matching Summary

Match Score: 85

NVIDIA is seeking a Deep Learning Architect for LLM Inference, targeting new college graduates from the class of 2026. The role involves optimizing inference server performance for large language models and requires a strong background in deep learning, programming, and collaboration within a fast-paced environment.

Salary

Base: 124,000 USD - 195,500 USD (Level 2); 152,000 USD - 241,500 USD (Level 3); Equity and benefits eligible

Skills & Requirements

Must-have

  • Deep learning inference serving
  • PyTorch programming
  • Profiling and compiler optimizations
  • LLM applications with OpenAI API
  • CPU and GPU microarchitecture
  • Complex software projects

Nice-to-have

  • Agentic AI tools in the workplace
  • Databases and visualization tools
  • Drive to improve performance

Key Requirements

  • Master's or PhD degree
  • Relevant software development experience
  • Work authorization for the US

Work Rights

Not specified

Tailored Resume

Cover Letter