The role involves designing, developing, and executing testing strategies to validate functionality, performance, and user experience for AI applications
Job Summary
The role involves designing, developing, and executing testing strategies to validate functionality, performance, and user experience for AI applications.
Candidates will collaborate with cross-functional teams to identify and resolve defects and continuously improve testing processes and methodologies.
The position emphasizes adherence to secure coding practices, leadership or collaborative guidance, and fostering a culture of technical excellence and growth.
Matching Summary
The role involves designing, developing, and executing testing strategies to validate functionality, performance, and user experience for AI applications.
Skills & Requirements
Must-have
Python programming for test automation
Generative AI and Agentic AI experience
Machine Learning model testing
Natural Language Processing quality assurance
AWS services including Bedrock and Lambda
CI/CD pipeline design and optimization
Agile/Scrum methodology and DevOps culture
Nice-to-have
Containerization with Docker and Kubernetes
Data engineering or data quality testing
Leadership and coaching skills
Cross-functional collaboration
Behavior-Driven Development frameworks
Knowledge of AI ethics and bias detection
Experience with test management tools
Key Requirements
Understanding of Large Language Models and LangChain
Experience with prompt engineering and LLM evaluation frameworks
Proficiency with version control systems like Git and Stash
Proven experience in establishing quality gates and governance frameworks
Expertise in UI, mobile, and API testing methodologies