Senior Product Manager, Ai Inference - Dynamo

Nvidia Corporation

Multiple Locations
Base: 208,000 usd - 327,750 usd; bonus/equity: eli...
**
Ai inference and distributed systems
Llm inference lifecycle and kv cache
Hardware-software co-design for performance
** Nvidia Corporation is seeking a Senior Product Manager for their Dynamo AI Inference framework. This role involves defining the product roadmap and collaborating on hardware-software optimization, requiring extensive experience in product management, AI inference, and distributed systems. **

Job Summary

  • Define the roadmap for high-scale LLM and Generative AI serving, bridging hardware and software optimizations.
  • Drive product strategy for core Dynamo architecture components, inference orchestration, and memory management.
  • Collaborate with engineering to ensure Dynamo extracts maximum performance from NVIDIA hardware and partner with open-source communities.

Matching Summary

Match Score: 75

** Nvidia Corporation is seeking a Senior Product Manager for their Dynamo AI Inference framework. This role involves defining the product roadmap and collaborating on hardware-software optimization, requiring extensive experience in product management, AI inference, and distributed systems. **

Salary

Base: 208,000 USD - 327,750 USD; Bonus/Equity: Eligible for equity; Benefits: Comprehensive benefits package

Skills & Requirements

Must-have

  • AI inference and distributed systems
  • LLM inference lifecycle and KV cache
  • Hardware-software co-design for performance
  • Ecosystem integration with open-source communities
  • Product strategy for modular components

Nice-to-have

  • Agentic frameworks and multi-turn AI
  • Trends in LLMs and Generative AI
  • Hands-on AI/LLM solution building
  • Customer empathy and product passion

Key Requirements

  • 12+ years in product management or technical role
  • Bachelors Degree in Computer Science or equivalent
  • Proven experience in AI inference, distributed systems, GPU computing
  • Deep understanding of LLM inference, KV cache, disaggregated serving
  • Ability to translate technical capabilities to business value

Work Rights

Not specified

Tailored Resume

Cover Letter