Principal Ai Quality Developer

Autodesk

Toronto, Canada
Base: $99,000 - $145,200 cad; bonus/equity: annual...
Ai/ml system testing
Llm and ml output evaluation
Ci/cd test automation
This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team

Job Summary

  • This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.
  • You will lead the quality strategy for applied AI experiences that directly impact product experience and customer outcomes.
  • Autodesk is committed to diversity, flexibility, and continuous learning, offering a collaborative environment where you can grow your skills and make a real impact.

Matching Summary

This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.

Salary

Base: $99,000 - $145,200 CAD; Bonus/Equity: Annual cash bonuses, stock grants; Benefits: Comprehensive benefits package

Skills & Requirements

Must-have

  • AI/ML system testing
  • LLM and ML output evaluation
  • CI/CD test automation
  • Responsible AI practices
  • Production monitoring for AI features

Nice-to-have

  • Observability tooling and telemetry
  • Cloud platforms (AWS preferred)
  • Responsible AI testing
  • Domain knowledge in AEC/design/manufacturing

Key Requirements

  • 7+ years quality engineering experience
  • Strong Python programming skills
  • Experience testing AI or ML systems
  • Experience validating LLM-based systems
  • Bachelor’s degree or equivalent experience

Work Rights

Not specified

Tailored Resume

Cover Letter