Data Scientist - Ai Evaluation

Wizardcommerce

Remote, US
Base: $225,000 - $280,000 usd; bonus/equity: equit...
Fully remote
Define and evolve accuracy metrics
Design and run experiments
Build evaluation datasets and benchmarks
Wizardcommerce is seeking a Data Scientist to enhance the accuracy and performance of their AI Shopping Agent through evaluation and experimentation. The role focuses on measurement and insight generation rather than model building, requiring strong experience in AI/ML evaluation and experimentation

Job Summary

  • This role sits at the intersection of data science, machine learning and product and is focused on evaluation, experimentation and insight generation.
  • You won’t be building models but you will make sure they work in real world scenarios.
  • In addition to base salary, Wizard offers equity, medical, dental, and vision coverage, a 401(k) plan, and flexible PTO.

Matching Summary

Match Score: 85

Wizardcommerce is seeking a Data Scientist to enhance the accuracy and performance of their AI Shopping Agent through evaluation and experimentation. The role focuses on measurement and insight generation rather than model building, requiring strong experience in AI/ML evaluation and experimentation.

Salary

Base: $225,000 - $280,000 USD; Bonus/Equity: Equity in the form of stock options; Benefits: Medical, dental, and vision coverage, 401(k) plan, Flexible PTO

Skills & Requirements

Must-have

  • Define and evolve accuracy metrics
  • Design and run experiments
  • Build evaluation datasets and benchmarks
  • Translate product questions into hypotheses
  • Partner with ML Engineers
  • Identify failure modes and edge cases
  • Create dashboards and reporting

Nice-to-have

  • Strong product mindset
  • Care about real user outcomes
  • Clear communication and influence

Key Requirements

  • 4-6+ years in Data Science, ML Evaluation or Applied AI
  • Deep experience evaluating AI/ML systems
  • Strong experience with experimentation
  • Experience working on consumer products or user facing systems
  • Exposure to marketplace or e-commerce systems

Work Rights

Fully remote within the United States

Tailored Resume

Cover Letter