Data Scientist, AWS Quick Data

Amazon

Santa Clara, CA, US
Not specified; not specified; not specified
On-site
Design evaluation datasets for generative ai
Leverage llms for synthetic data generation
Create ground truth question-answer pairs
The role focuses on engineering high-quality datasets essential for the success of Amazon Quick Suite's generative AI features

Job Summary

  • The role focuses on engineering high-quality datasets essential for the success of Amazon Quick Suite's generative AI features.
  • Candidates will leverage LLMs for synthetic data generation and use LLM-as-a-judge settings for data evaluation and quality assessment.
  • The team offers a hybrid work model, mentorship opportunities, and a culture that values inclusion and continuous learning.

Matching Summary

The role focuses on engineering high-quality datasets essential for the success of Amazon Quick Suite's generative AI features.

Salary

Not specified; Not specified; Not specified

Skills & Requirements

Must-have

  • Design evaluation datasets for generative AI
  • Leverage LLMs for synthetic data generation
  • Create ground truth question-answer pairs
  • Lead human annotation initiatives
  • Conduct statistical analysis on model performance
  • Develop Responsible AI safety datasets

Nice-to-have

  • Collaborate with diverse cross-functional teams
  • Experience with Retrieval-Augmented Generation
  • Commitment to customer obsession and excellence
  • Knowledge of enterprise-grade security governance

Key Requirements

  • Data Scientist II level experience
  • Expertise in data-centric AI principles
  • Proficiency in statistical analysis methods

Work Rights

Not specified

Tailored Resume

Cover Letter