The Agentic AI Evaluation Engineer position at Comcast involves designing and developing evaluation systems for AI agents to ensure their accuracy and reliability. The role requires expertise in AI metrics, benchmarking, and collaboration with engineering and product teams. The position is fully remote and offers competitive compensation and comprehensive benefits
Job Summary
The role involves designing and developing agent evaluation pipelines across development, staging, and production environments to ensure AI agents perform consistently.
Candidates will define standard evaluation metrics for conversational AI quality, including accuracy, relevance, customer experience, and safety.
Comcast offers a competitive base pay range of $142,651.46 - $213,977.19 along with best-in-class benefits and bonus eligibility.
Matching Summary
Match Score: 85
The Agentic AI Evaluation Engineer position at Comcast involves designing and developing evaluation systems for AI agents to ensure their accuracy and reliability. The role requires expertise in AI metrics, benchmarking, and collaboration with engineering and product teams. The position is fully remote and offers competitive compensation and comprehensive benefits.
Salary
Base: $142,651.46 - $213,977.19; Bonus: Eligible for non-sales positions; Benefits: Best-in-class array of options provided