Not specified; not specified; competitive pyy, ret...
Hybrid
8+ years quality engineering experience
Expert-level python programming
Testing generative ai and llms
S&P Global is seeking a Senior Lead QA Engineer to oversee the quality of AI-driven autonomous agents, focusing on testing and validating their reasoning and actions. The role demands extensive experience in Quality Engineering, particularly in AI and automation, along with leadership capabilities
Job Summary
This role serves as the guardian of AI reliability by designing frameworks to validate the unpredictable nature of Large Language Models within agentic workflows.
The team is responsible for the 'Trust Layer' of S&P Global's AI transformation, ensuring autonomous agents act reliably and securely across GCP, AWS, and Azure environments.
Candidates will lead red-teaming efforts to prevent hallucinations and data leakage while translating complex technical quality metrics into business confidence for stakeholders.
Matching Summary
Match Score: 85
S&P Global is seeking a Senior Lead QA Engineer to oversee the quality of AI-driven autonomous agents, focusing on testing and validating their reasoning and actions. The role demands extensive experience in Quality Engineering, particularly in AI and automation, along with leadership capabilities.
Salary
Not specified; Not specified; Competitive pay, retirement planning, health care coverage, generous time off, continuing education program
Skills & Requirements
Must-have
8+ years Quality Engineering experience
Expert-level Python programming
Testing Generative AI and LLMs
Automated workflow testing strategies
Enterprise API integration testing
Multicloud AI platform knowledge
Leadership of QA engineering teams
Nice-to-have
Experience with LangChain or LangGraph
Knowledge of vector databases and RAG
ISTQB Advanced Level certification
Cloud certifications from Google AWS Azure
Performance engineering for LLM latency
Background in ServiceNow or Workato
Key Requirements
8+ years in Quality Engineering or SDET
5+ years focused on automated workflow testing
Proven track record testing ServiceNow or Salesforce