Ai Testing Engineer Manager

Crowe UK

Multiple Locations
$102,400.00 - $204,100.00 py
Hybrid
Ai testing strategies
Automated evaluation frameworks
Model behavior assessment
This role leads advanced testing and validation efforts, architects automated evaluation frameworks, and assesses model behavior across functional and non-functional dimensions, including accuracy, robustness, bias, drift, and safety

Job Summary

  • This role leads advanced testing and validation efforts, architects automated evaluation frameworks, and assesses model behavior across functional and non-functional dimensions, including accuracy, robustness, bias, drift, and safety.
  • The AI Transformation team will build on Crowe’s established AI foundation, furthering the capabilities of our Applied AI / Machine Learning team by combining Generative AI, Machine Learning and Software Engineering.
  • Crowe offers unlimited PTO, a flexible remote work policy, and a supportive environment that prioritizes sustainable, long-term performance.

Matching Summary

This role leads advanced testing and validation efforts, architects automated evaluation frameworks, and assesses model behavior across functional and non-functional dimensions, including accuracy, robustness, bias, drift, and safety.

Salary

$102,400.00 - $204,100.00 per year

Skills & Requirements

Must-have

  • AI testing strategies
  • automated evaluation frameworks
  • model behavior assessment
  • Python and automated testing
  • LLM evaluation metrics
  • responsible AI adoption

Nice-to-have

  • continuous growth and knowledge-sharing
  • flexible remote work policy
  • sustainable long-term performance
  • collaboration across teams
  • mentoring junior engineers

Key Requirements

  • 7+ years of experience
  • Bachelor's degree or equivalent experience
  • Cloud ML platforms experience
  • CI/CD pipeline integration
  • Generative AI testing experience

Work Rights

Not specified

Tailored Resume

Cover Letter