Ai Benchmarking Specialist, Sp Support - French, International Seller Growth

Amazon

Ka, Karnataka, India
On-site
Ai model evaluation
Benchmarking and audit activities
Content accuracy and relevancy checks
Amazon is seeking an AI Benchmarking Specialist to join their Seller AI team in Karnataka, India. This role focuses on evaluating AI systems through benchmarking and audit activities to ensure model quality and compliance, contributing to a superior seller experience on Amazon. ###

Job Summary

  • The AI Benchmarking Associate supports the evaluation of AI systems by designing and executing benchmarking and audit activities to assess model quality, compliance, robustness, and fairness.
  • Assist in planning and executing benchmarking exercises for AI models, including defining test plans, metrics, and acceptance criteria across accuracy, robustness, bias, and reliability.
  • Prepare clear audit and benchmarking reports, including error ratings, root-cause analysis, and recommendations, and contribute to presentations for senior stakeholders.

Matching Summary

Match Score: 85

Amazon is seeking an AI Benchmarking Specialist to join their Seller AI team in Karnataka, India. This role focuses on evaluating AI systems through benchmarking and audit activities to ensure model quality and compliance, contributing to a superior seller experience on Amazon. ###

Skills & Requirements

Must-have

  • AI model evaluation
  • benchmarking and audit activities
  • content accuracy and relevancy checks
  • annotation guidelines validation
  • error ratings and root-cause analysis

Nice-to-have

  • process efficiencies and automation
  • continuous improvement of methodologies
  • stakeholder communication

Key Requirements

  • French language proficiency
  • Experience with AI auditing
  • Experience with quality assurance

Work Rights

Not specified

Tailored Resume

Cover Letter