Applied Ai Evaluation Engineer

BMO

Toronto, Canada
Base: $82,800.00 - $154,800.00; bonus/equity: not ...
Hybrid
Design evaluation frameworks
Implement evaluation pipelines
Optimize ai system performance
BMO’s Applied AI team sets the standard for safe, high-performing AI systems across the bank, building BMO’s leading-edge AI products and capabilities

Job Summary

  • BMO’s Applied AI team sets the standard for safe, high-performing AI systems across the bank, building BMO’s leading-edge AI products and capabilities.
  • As an Engineering & Data Science Specialist in Applied AI Evaluations, you will design, implement, and optimize evaluation frameworks and pipelines that measure the quality, safety, and performance of advanced AI systems at BMO.
  • BMO also offers health insurance, tuition reimbursement, accident and life insurance, and retirement savings plans.

Matching Summary

BMO’s Applied AI team sets the standard for safe, high-performing AI systems across the bank, building BMO’s leading-edge AI products and capabilities.

Salary

Base: $82,800.00 - $154,800.00; Bonus/Equity: Not specified; Benefits: health insurance, tuition reimbursement, accident and life insurance, retirement savings plans

Skills & Requirements

Must-have

  • design evaluation frameworks
  • implement evaluation pipelines
  • optimize AI system performance
  • Python programming skills
  • ML/AI frameworks experience
  • LLM evaluation pipelines

Nice-to-have

  • high-impact collaboration
  • fast-paced environments
  • responsible innovation culture
  • continuous learning
  • regulatory compliance adherence

Key Requirements

  • 7+ years engineering or data science
  • 3 years in AI/ML/data-driven products
  • Strong programming skills
  • ML/AI frameworks experience
  • LLM/AI system evaluation pipelines
  • Deep learning concepts understanding
  • MLOps, CI/CD, cloud AI infrastructure familiarity
  • Leadership experience
  • Strong analytical and problem-solving skills

Work Rights

Not specified

Tailored Resume

Cover Letter