Software Quality Engineer - Ai

Boomilp

Canada, Canada
On-site
Backend services testing
Api and microservices testing
Automated testing frameworks
Boomi is seeking a Senior Software Quality Engineer with a strong focus on AI and automated testing. The role involves designing and implementing testing strategies for backend services and AI features in a collaborative environment

Job Summary

  • As a Senior Software Quality Engineer, you will bridge traditional software quality engineering with cutting-edge AI quality practices, designing and implementing comprehensive testing strategies.
  • You will design and implement automated evaluation frameworks for Generative AI features, including LLM / SLM model testing, prompt/ output validation, and behavioral assessment of agentic workflows.
  • You will establish observability and monitoring requirements including structured logging, metrics collection, and tracing for both backend services and AI agent behavior.

Matching Summary

Match Score: 85

Boomi is seeking a Senior Software Quality Engineer with a strong focus on AI and automated testing. The role involves designing and implementing testing strategies for backend services and AI features in a collaborative environment.

Skills & Requirements

Must-have

  • backend services testing
  • API and microservices testing
  • automated testing frameworks
  • Generative AI feature testing
  • LLM/SLM model testing
  • Python or Java programming skills

Nice-to-have

  • quality-first practices advocacy
  • mentoring junior engineers
  • cloud environments testing
  • containerized execution testing
  • performance and load testing

Key Requirements

  • 2.5+ years of experience in software quality engineering
  • Deep expertise in test automation frameworks
  • Strong programming skills in Python or Java

Work Rights

Not specified

Tailored Resume

Cover Letter