Rakuten Asia Pte. Ltd. is seeking a Senior Product Manager for its LLM API Platform, tasked with developing and optimizing the internal API infrastructure to enhance developer workflows and improve cost efficiency. The ideal candidate will have extensive experience in technical product management, particularly with API products and AI/ML platforms
Job Summary
The role involves owning the vision and strategy for Rakuten's internal LLM API Platform to power AI-nization across global engineering teams.
You will be responsible for advocating the migration from external LLM providers to in-house solutions by demonstrating superior Total Cost of Ownership.
The position requires collaborating with GPU engineers to ensure high-availability services with rigorous latency SLAs and security compliance.
Matching Summary
Match Score: 85
Rakuten Asia Pte. Ltd. is seeking a Senior Product Manager for its LLM API Platform, tasked with developing and optimizing the internal API infrastructure to enhance developer workflows and improve cost efficiency. The ideal candidate will have extensive experience in technical product management, particularly with API products and AI/ML platforms.
Skills & Requirements
Must-have
5+ years Technical PM experience
API Product management expertise
LLM inference lifecycle knowledge
Enterprise API reliability standards
Cost-benefit model building skills
Nice-to-have
Experience with Internal Developer Platforms
Background in API-as-a-Product
Familiarity with vLLM or SGLang frameworks
Experience productizing infrastructure for B2B clients