This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions
Job Summary
This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions.
You will establish the frameworks, processes and standards that evaluate LLM behaviour, MCP tool usage, and natural-language output quality across multiple AI stacks.
Collaborate with product teams across Data & Analytics, Markets, FTSE Russell and Risk Intelligence to integrate the evaluation framework into their AI initiatives.
Matching Summary
This role will define how LSEG measures the accuracy, reliability and consistency of AI-powered interactions across our data, analytics and market solutions.
Skills & Requirements
Must-have
AI Evaluation Framework design
LLM behavior evaluation
Test automation strategy
Scalable automated evaluation pipelines
Responsible AI standards alignment
Nice-to-have
Financial data workflows
Collaborative and creative culture
Continuous improvement mindset
Emerging testing methodologies insights
Key Requirements
Product management, QA/test automation, or ML evaluation frameworks experience
Experience designing structured test systems at scale
Strong knowledge of LLMs, prompt engineering, and tool-augmented LLM workflows
Familiarity with financial data, analytics workflows, or MCP-style interoperability