The incumbent will lead the bank's GenAI testing approach, ensuring LLM and RAG solutions are accurate, safe and reliable
Job Summary
The incumbent will lead the bank's GenAI testing approach, ensuring LLM and RAG solutions are accurate, safe and reliable.
Responsibilities include developing comprehensive test strategies for GenAI applications and implementing test automation frameworks for LLM-based systems.
The role involves leading a team of QA engineers and coordinating with data scientists, MLOps, architects, and business SMEs to drive knowledge sharing on GenAI testing best practices.
Matching Summary
The incumbent will lead the bank's GenAI testing approach, ensuring LLM and RAG solutions are accurate, safe and reliable.
Skills & Requirements
Must-have
GenAI testing and evaluation
LLM and RAG solution testing
Enterprise QA governance
Test automation frameworks
Cross-functional team leadership
AI model evaluation metrics
Nice-to-have
Strong problem-solving skills
Stakeholder communication
Knowledge sharing culture
Experience with diverse teams
Continuous learning mindset
Key Requirements
Bachelor’s or Master’s degree in computer engineering or related field