Ai Benchmarking Lead, Performance Benchmarking Evaluation

Amazon

Ts, IN, United States
On-site
Ai model evaluation
Audit reliability and consistency
Quality standards enforcement
Join a mission-critical team supporting Amazon's Gen-AI powered copilot, Seller Assistant, to help sellers navigate Amazon's ecosystem and grow their businesses

Job Summary

  • Join a mission-critical team supporting Amazon's Gen-AI powered copilot, Seller Assistant, to help sellers navigate Amazon's ecosystem and grow their businesses.
  • You will benchmark Seller Assistant AI models for relevancy, correctness, and completeness, improving audit reliability and enforcing quality standards.
  • Your role involves identifying rubric gaps, surfacing product issues, and serving as a point of contact for annotation tasks across ML data process areas.

Matching Summary

Join a mission-critical team supporting Amazon's Gen-AI powered copilot, Seller Assistant, to help sellers navigate Amazon's ecosystem and grow their businesses.

Skills & Requirements

Must-have

  • AI model evaluation
  • audit reliability and consistency
  • quality standards enforcement
  • ML data process areas
  • SOP modification and documentation

Nice-to-have

  • understanding customer impact
  • continuous process improvement
  • collating and reporting metrics

Key Requirements

  • Quality Assurance Specialist
  • AI Benchmarking Lead

Work Rights

Not specified

Tailored Resume

Cover Letter