Artificial Intelligence- Qa

Barclays

Pune, India
Large language models (llm)
Langchain and langgraph frameworks
Python programming skills
Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI solutions

Job Summary

  • Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI solutions.
  • Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies.
  • Ensure software quality and reliability by adhering to secure coding practices and implementing effective unit testing.

Matching Summary

Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI solutions.

Skills & Requirements

Must-have

  • Large Language Models (LLM)
  • LangChain and LangGraph frameworks
  • Python programming skills
  • Generative AI and Agentic AI
  • Machine Learning model testing
  • Natural Language Processing (NLP) QA
  • prompt engineering and LLM evaluation

Nice-to-have

  • containerization for test environments
  • data engineering or data quality testing
  • publications or conference presentations
  • contributions to open-source frameworks

Key Requirements

  • Understanding of LLM, LangChain, LangGraph
  • Python programming
  • Generative AI implementations
  • ML model testing methodologies
  • NLU testing strategies
  • NLP quality assurance
  • Prompt engineering and LLM evaluation
  • Vector databases for RAG testing
  • Performance and load testing Gen AI
  • AI ethics, bias detection
  • AWS services (Bedrock, Lambda, CloudWatch)
  • Enterprise-scale cloud testing solutions
  • Version control systems (Git, Stash)
  • CI/CD pipelines (Jenkins, GitLab CI)
  • Agile/Scrum methodology, SDLC, DevOps
  • Drive quality initiatives
  • Cross-functional collaboration
  • Quality gates for Gen AI applications
  • UI, mobile and API testing
  • Behavior-Driven Development (BDD)

Work Rights

Not specified

Tailored Resume

Cover Letter