Lead Data And Ai Quality Engineer

RBC

Toronto, Canada
Python proficiency
Ai code agent testing
Llm testing expertise
This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards

Job Summary

  • This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.
  • Design and execute comprehensive test strategies for AI code agents and autonomous systems, evaluating AI agent performance metrics.
  • We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper.

Matching Summary

This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.

Skills & Requirements

Must-have

  • Python proficiency
  • AI code agent testing
  • LLM testing expertise
  • Automated test frameworks
  • CI/CD pipeline automation

Nice-to-have

  • Data governance frameworks
  • AI agent orchestration tools
  • Infrastructure as Code best practices

Key Requirements

  • 5+ years of hands-on Python development experience
  • Experience testing AI models and machine learning systems
  • Experience designing and testing AI code agents
  • Demonstrated expertise in Large Language Model (LLM) testing
  • Knowledge of relational and non-relational databases
  • Proficiency with Git and GitHub Actions

Work Rights

Not specified

Tailored Resume

Cover Letter