Principal Ai Quality Developer

AUTODESK CONSTRUCTION CLOUD

Toronto, Canada
Base: $99,000 - $145,200; bonus/equity: annual cas...
Ai/ml system testing
Llm and ml output evaluation
Ci/cd test automation
This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team

Job Summary

  • This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.
  • You will lead the quality strategy for applied AI experiences that directly impact product experience and customer outcomes.
  • Autodesk is a global leader in 3D design, engineering, and entertainment software, empowering innovators everywhere to imagine, design, and make a better world.

Matching Summary

This role is responsible for validating the quality, safety, reliability, and performance of AI features and agentic workflows shipped by the applied AI engineering team.

Salary

Base: $99,000 - $145,200; Bonus/Equity: Annual cash bonuses, stock grants; Benefits: Comprehensive benefits package

Skills & Requirements

Must-have

  • AI/ML system testing
  • LLM and ML output evaluation
  • CI/CD test automation
  • AI safety and abuse testing
  • Production monitoring for AI features

Nice-to-have

  • Responsible AI practices
  • Observability tooling and telemetry
  • Cloud platforms (AWS preferred)
  • Domain knowledge in AEC

Key Requirements

  • 7+ years of experience in quality engineering
  • Strong programming skills in Python
  • Hands-on experience testing AI or ML systems
  • Practical experience validating LLM-based systems
  • Bachelor’s degree in Computer Science or equivalent experience

Work Rights

Not specified

Tailored Resume

Cover Letter