Not specified (assumed to be hybrid based on industry standards)
Nvidia dynamo product roadmap
Llm and generative ai serving
Hardware-software co-design
NVIDIA is looking for a Senior Product Manager for its Dynamo distributed inference framework, focusing on AI and LLM technologies. The ideal candidate should have extensive experience in product management, particularly in AI inference and distributed systems, along with strong technical skills
Job Summary
Drive the product strategy for Dynamo’s modular components, including the KV-aware Router, KV Block Manager (KVBM), and communication planes.
Define requirements for sophisticated routing logic that minimizes redundant prefill and optimizes Time to First Token (TTFT) across substantial GPU clusters.
NVIDIA offers highly competitive salaries and a comprehensive benefits package.
Matching Summary
Match Score: 85
NVIDIA is looking for a Senior Product Manager for its Dynamo distributed inference framework, focusing on AI and LLM technologies. The ideal candidate should have extensive experience in product management, particularly in AI inference and distributed systems, along with strong technical skills.