Design, develop, and execute testing strategies to validate functionality, performance, and user experience
Job Summary
Design, develop, and execute testing strategies to validate functionality, performance, and user experience.
Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies.
Stay informed of industry technology trends and innovations and actively contribute to the organization’s technology communities to foster a culture of technical excellence and growth.
Matching Summary
Design, develop, and execute testing strategies to validate functionality, performance, and user experience.
Skills & Requirements
Must-have
Large Language Models (LLM)
LangChain and LangGraph frameworks
Python programming skills
Generative AI and Agentic AI
Machine Learning model testing
Natural Language Processing (NLP) quality assurance
prompt engineering and LLM evaluation
AWS services (Bedrock, Lambda, CloudWatch)
CI/CD pipelines (Jenkins, GitLab CI)
Agile/Scrum methodology, SDLC best practices
DevOps culture
enterprise-scale cloud-based testing solutions
version control systems (Git, Stash)
Nice-to-have
data engineering or data quality testing
publications, conference presentations
containerization (Docker, Kubernetes)
risk and controls
change and transformation
business acumen
strategic thinking
digital and technology
Key Requirements
Understanding of Large Language Models (LLM)
Python programming skills
Deep hands-on experience with Generative AI
Machine Learning model testing
Natural Language Understanding (NLU) testing
Natural Language Processing (NLP) quality assurance