Agent Evaluation Engineer

Sky (Comcast)

Base: $142,651.46 - $213,977.19; bonus/equity: not...
**
Ai agents evaluation pipelines
Evaluation metrics and benchmarks
Automated evaluation systems
** Sky (Comcast) is seeking an Agent Evaluation Engineer for a fully remote position. The role involves designing evaluation pipelines and metrics for AI agents, ensuring their performance aligns with user expectations. **

Job Summary

  • The Agent Evaluation team ensures AI agents perform consistently and meet user expectations.
  • You will design and develop evaluation pipelines and manage datasets for agent performance.
  • Comcast offers a collaborative environment that values innovation and employee contributions.

Matching Summary

Match Score: 75

** Sky (Comcast) is seeking an Agent Evaluation Engineer for a fully remote position. The role involves designing evaluation pipelines and metrics for AI agents, ensuring their performance aligns with user expectations. **

Salary

Base: $142,651.46 - $213,977.19; Bonus/Equity: Not specified; Benefits: Best-in-class benefits

Skills & Requirements

Must-have

  • AI agents evaluation pipelines
  • evaluation metrics and benchmarks
  • automated evaluation systems
  • CI/CD integration

Nice-to-have

  • experience in customer support AI
  • understanding of responsible AI
  • curious mindset

Key Requirements

  • Bachelor's Degree preferred
  • 5-7 years relevant experience

Work Rights

Not specified

Tailored Resume

Cover Letter