Define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions
Job Summary
Define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions.
Establish the frameworks, processes and standards that evaluate LLM behaviour, MCP tool usage, and natural-language output quality across multiple AI stacks.
Collaborate with product teams across Data & Analytics, Markets, FTSE Russell and Risk Intelligence to integrate the evaluation framework into their AI initiatives.
Matching Summary
Define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions.
Skills & Requirements
Must-have
AI Evaluation Framework design
LLM behavior evaluation
Test automation pipelines
Responsible AI standards
Financial data workflows
Nice-to-have
Collaborative and creative culture
Continuous improvement mindset
Sustainability commitment
Key Requirements
Product management, QA/test automation, or ML evaluation frameworks experience
Experience designing structured test systems at scale
Familiarity with financial data, analytics workflows, or MCP-style interoperability