Senior Qa (gen Ai - Must Have) Exp: 5+ Years

Fractal Analytics

5+ years backend api test automation
Experience validating ml/llm systems
Python or typescript proficiency
The role requires designing automated evaluation pipelines tied to releases for LLM quality and safety

Job Summary

  • The role requires designing automated evaluation pipelines tied to releases for LLM quality and safety.
  • Candidates must partner with Product, Clinical, and R&D teams to refine requirements for regulated lifecycles.
  • The position involves enforcing build-time gates for both API and LLM quality within Azure DevOps.

Matching Summary

The role requires designing automated evaluation pipelines tied to releases for LLM quality and safety.

Skills & Requirements

Must-have

  • 5+ years backend API test automation
  • Experience validating ML/LLM systems
  • Python or TypeScript proficiency
  • CI/CD integration with Azure DevOps
  • Performance testing with k6 or JMeter

Nice-to-have

  • Frontend testing capabilities preferred
  • FHIR/HL7 data format familiarity
  • Healthcare data privacy knowledge
  • Strong documentation discipline

Key Requirements

  • 5+ years of experience in QA
  • Backend/API test automation expertise
  • Validated ML/LLM system experience

Work Rights

Not specified

Tailored Resume

Cover Letter