Program Manager, Ai Model Evaluation, International Seller Growth

Amazon

China
**
Ai model benchmarking and evaluation
Llm performance validation
Develop benchmarking methodologies
** Amazon is seeking a Program Manager for their Seller AI team in China, responsible for overseeing the benchmarking and evaluation of AI models aimed at enhancing the seller experience. This role combines strategic leadership with hands-on technical oversight, requiring strong communication skills and team management. **

Job Summary

  • You'll lead benchmarking and evaluation of AI models that enhance the seller experience across Amazon's global marketplace.
  • This role combines strategic leadership with hands-on technical oversight, requiring exceptional communication skills, team management, and stakeholder engagement.
  • The Seller AI team within International Seller Services is dedicated to creating Gen-AI/LLM powered tools and agentic solutions that accelerate business growth for Amazon sellers worldwide.

Matching Summary

Match Score: 75

** Amazon is seeking a Program Manager for their Seller AI team in China, responsible for overseeing the benchmarking and evaluation of AI models aimed at enhancing the seller experience. This role combines strategic leadership with hands-on technical oversight, requiring strong communication skills and team management. **

Skills & Requirements

Must-have

  • AI model benchmarking and evaluation
  • LLM performance validation
  • Develop benchmarking methodologies
  • Analyze AI model performance metrics
  • Translate technical findings to insights

Nice-to-have

  • Strategic leadership
  • Hands-on technical oversight
  • Team management
  • Stakeholder engagement
  • Process efficiency exploration

Key Requirements

  • Experience in AI model evaluation
  • Experience in benchmarking AI models
  • Experience in leading teams
  • Experience in data annotation guidelines
  • Experience in root-cause analysis

Work Rights

Not specified

Tailored Resume

Cover Letter