Ai Enablement & Governance– Ai Quality & Evaluation Lead

Alight

Base: $150,000.00 - $200,000.00 usd; bonus/equity:...
**
5-8 years data science ml engineering experience
Expert-level python pandas scikit-learn skills
Rag and llm-based agents system design
** Alight is seeking an AI Quality & Evaluation Lead to enhance responsible AI adoption by establishing quality standards and evaluation frameworks. The role involves collaborating with AI Engineers, Data Scientists, and Product teams to ensure that AI solutions are robust, accurate, and aligned with governance expectations. **

Job Summary

  • The role enables responsible and scalable AI adoption by defining technical quality standards and evaluation frameworks across the AI lifecycle.
  • Alight offers a comprehensive total rewards package including health, dental, and vision coverage starting Day One, along with generous time off and parental leave.
  • The company has been recognized as a 'Top 100 Company for Remote Jobs' for six consecutive years and a 'Great Place to Work' for seven years.

Matching Summary

Match Score: 75

** Alight is seeking an AI Quality & Evaluation Lead to enhance responsible AI adoption by establishing quality standards and evaluation frameworks. The role involves collaborating with AI Engineers, Data Scientists, and Product teams to ensure that AI solutions are robust, accurate, and aligned with governance expectations. **

Salary

Base: $150,000.00 - $200,000.00 USD; Bonus/Equity: Not specified; Benefits: Comprehensive total rewards package including health, dental, vision, retirement matching, and paid time off

Skills & Requirements

Must-have

  • 5-8 years Data Science ML Engineering experience
  • Expert-level Python Pandas Scikit-learn skills
  • RAG and LLM-based Agents system design
  • Generative AI evaluation metrics development
  • Fairness bias evaluation criteria definition
  • Drift monitoring and statistical triggers
  • CI/CD pipeline quality integration

Nice-to-have

  • Experience with RAGAS TruLens or MLflow frameworks
  • Ability to work without direct authority
  • Bridge governance policy and code implementation
  • Third-party vendor model evaluation experience
  • Audit and regulatory review documentation

Key Requirements

  • Bachelor's degree in Computer Science or equivalent
  • 5-8+ years of experience in Data Science or ML Engineering
  • Work authorization without future visa sponsorship required

Work Rights

Must have work authorization that does not require visa sponsorship

Tailored Resume

Cover Letter