The role involves designing and executing comprehensive testing strategies to validate the functionality and performance of Generative AI applications
Job Summary
The role involves designing and executing comprehensive testing strategies to validate the functionality and performance of Generative AI applications.
Candidates must possess deep hands-on experience with Large Language Models, LangChain, and Agentic AI implementations in production environments.
The position requires leading cross-functional collaboration to establish quality gates and governance frameworks for Gen AI solutions while adhering to responsible AI practices.
Matching Summary
The role involves designing and executing comprehensive testing strategies to validate the functionality and performance of Generative AI applications.
Skills & Requirements
Must-have
Python programming skills
Generative AI implementation experience
LLM and LangChain frameworks knowledge
AWS Bedrock and Lambda services
NLP and NLU testing strategies
CI/CD pipeline optimization with Jenkins
Vector databases for RAG testing
Nice-to-have
Docker and Kubernetes containerization
Data engineering background
Open-source framework contributions
Conference presentation experience
Behavior-Driven Development (BDD) proficiency
UI and mobile testing methodologies
Key Requirements
Assistant Vice President level experience
Expert proficiency in Python and Git
Deep understanding of Agile/Scrum methodology
Proven ability to drive quality initiatives
Experience with test management tools like Jira and Xray