Qa - Ai

Barclays

Pune, India
Llm, langchain, langgraph frameworks
Python test automation
Generative ai production implementations
Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications

Job Summary

  • Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications.
  • Collaborate with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies.
  • Leverage expertise in LLMs, Generative AI, and cloud services to ensure software quality and reliability in production environments.

Matching Summary

Design, develop, and execute testing strategies to validate functionality, performance, and user experience for AI applications.

Skills & Requirements

Must-have

  • LLM, LangChain, LangGraph frameworks
  • Python test automation
  • Generative AI production implementations
  • ML model testing
  • NLU and NLP testing
  • Prompt engineering and LLM evaluation
  • Vector databases for RAG testing
  • AI ethics and bias detection

Nice-to-have

  • Data engineering background
  • Publications or open-source contributions
  • Containerization for test environments
  • Agile/Scrum methodology
  • DevOps culture

Key Requirements

  • 3+ years of experience in QA
  • Experience with Generative AI
  • Experience with AWS services
  • Experience with CI/CD pipelines
  • Experience with Agile/Scrum

Work Rights

Not specified

Tailored Resume

Cover Letter