Artificial Intelligence- Qa

Barclays

Bengaluru, India
Llm, langchain, langgraph frameworks
Python for scalable test automation
Generative ai production experience
Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications

Job Summary

  • Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications.
  • Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies.
  • Leverage expertise in LLMs, Generative AI, and cloud services to ensure software quality and reliability in a financial services context.

Matching Summary

Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications.

Skills & Requirements

Must-have

  • LLM, LangChain, LangGraph frameworks
  • Python for scalable test automation
  • Generative AI production experience
  • ML model testing and validation
  • NLU and NLP quality assurance
  • Prompt engineering and LLM evaluation
  • AWS Bedrock, Lambda, CloudWatch

Nice-to-have

  • Containerization for test environments
  • Data engineering or data quality testing
  • Publications or open-source contributions
  • UI, mobile, and API testing
  • Behavior-Driven Development (BDD)

Key Requirements

  • Understanding of Large Language Models (LLM)
  • Python programming skills
  • Hands-on experience with Generative AI
  • Machine Learning model testing
  • Natural Language Processing (NLP) QA
  • Knowledge of prompt engineering
  • Familiarity with vector databases
  • Experience with performance and load testing
  • Understanding of AI ethics
  • Knowledge of AWS services
  • Experience architecting cloud-based testing
  • Expert proficiency with version control systems
  • Proven experience designing CI/CD pipelines
  • Deep understanding of Agile/Scrum
  • Demonstrated ability to drive quality initiatives
  • Proven expertise in leading cross-functional collaboration
  • Experience establishing quality gates for Gen AI
  • Knowledge in UI, mobile and API testing
  • Advanced proficiency with BDD frameworks

Work Rights

Not specified

Tailored Resume

Cover Letter