Principal Qa Engineer – Genai Testing - Manager

State Street UK

Unknown, Unknown, United Kingdom
Hybrid
8+ years software quality assurance experience
Llm testing and prompt validation expertise
Selenium with python test automation
State Street UK is seeking a Principal QA Engineer specializing in GenAI testing and management, with a focus on testing Large Language Models (LLMs) and AI-driven workflows. The role involves extensive experience in software quality assurance, particularly in the context of emerging technologies within the financial services sector, and supports a hybrid work model

Job Summary

  • This role focuses on analyzing business specifications and executing test cases for emerging AI technologies in financial services.
  • Candidates will design and execute comprehensive test plans for Large Language Models, including safety compliance and accuracy checks.
  • The position supports a hybrid work model allowing employees to balance remote and office-based work requirements.

Matching Summary

Match Score: 85

State Street UK is seeking a Principal QA Engineer specializing in GenAI testing and management, with a focus on testing Large Language Models (LLMs) and AI-driven workflows. The role involves extensive experience in software quality assurance, particularly in the context of emerging technologies within the financial services sector, and supports a hybrid work model.

Skills & Requirements

Must-have

  • 8+ years software quality assurance experience
  • LLM testing and prompt validation expertise
  • Selenium with Python test automation
  • Pytest framework for automated scripts
  • SoapUI and web service automation
  • Jira bug tracking and management

Nice-to-have

  • BDD & TDD (Gherkin) methodology experience
  • Red teaming LLMs for vulnerability identification
  • AI governance and bias detection knowledge
  • OpenAI Evals and Ragas tool familiarity
  • CI/CD pipeline integration experience
  • Strong analytical and problem-solving skills

Key Requirements

  • 8 years of software QA testing experience
  • Hands-on experience with LLM and Agents testing
  • Proficiency in PyCharm, VS Code, Git, and JMeter
  • Experience with CI/CD-based projects
  • Basic understanding of AI and ML algorithms

Work Rights

Not specified

Tailored Resume

Cover Letter