Principal Ai Quality Developer

AUTODESK TLV

Toronto, Canada
Base: $99,000 - $145,200 cad; bonus/equity: annual...
Ai/ml system testing
Llm and ml output evaluation
Automated test harnesses
This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team

Job Summary

  • This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.
  • You will lead the quality strategy for applied AI experiences that directly impact product experience and customer outcomes.
  • We are committed to diversity, flexibility, and continuous learning, offering a collaborative environment where you can grow your skills and make a real impact.

Matching Summary

This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.

Salary

Base: $99,000 - $145,200 CAD; Bonus/Equity: Annual cash bonuses, stock grants; Benefits: Comprehensive benefits package

Skills & Requirements

Must-have

  • AI/ML system testing
  • LLM and ML output evaluation
  • Automated test harnesses
  • CI/CD integration
  • Responsible AI practices
  • Production monitoring for AI

Nice-to-have

  • Adversarial testing expertise
  • Observability tooling familiarity
  • Cloud platform experience
  • Responsible AI testing background
  • Domain knowledge in AEC

Key Requirements

  • 7+ years of quality engineering experience
  • Strong Python programming skills
  • Experience testing AI or ML systems
  • Practical LLM-based system validation
  • Bachelor’s degree or equivalent experience

Work Rights

Not specified

Tailored Resume

Cover Letter