Senior Ai Sdet

Reltio

Bangalore, India
On-site
Python proficiency with pandas and numpy
Langgraph crewai or autogen implementation
Rag pipeline development and vector databases
This role bridges AI development and automated validation by owning the full lifecycle of AI features from core logic to robust evaluation frameworks

Job Summary

  • This role bridges AI development and automated validation by owning the full lifecycle of AI features from core logic to robust evaluation frameworks.
  • Candidates will design autonomous agents using frameworks like LangGraph and build optimized RAG pipelines to ensure enterprise-ready systems.
  • The position requires developing hybrid automation frameworks that integrate AI tests into MLOps pipelines for continuous regression testing.

Matching Summary

This role bridges AI development and automated validation by owning the full lifecycle of AI features from core logic to robust evaluation frameworks.

Skills & Requirements

Must-have

  • Python proficiency with Pandas and NumPy
  • LangGraph CrewAI or AutoGen implementation
  • RAG pipeline development and vector databases
  • Automated evaluation frameworks for LLMs
  • Non-deterministic testing strategies
  • Microservices and async processing experience

Nice-to-have

  • Experience with synthetic data generation
  • LLM-assisted evaluation techniques
  • Mentorship and standards definition
  • Knowledge of JMeter or Locust performance testing
  • Agile environment collaboration

Key Requirements

  • 5+ years as SDET, QA Automation Engineer, or AI Engineer
  • 2+ years hands-on experience testing AI/ML products
  • Proven ability to write production-quality code

Work Rights

Not specified

Tailored Resume

Cover Letter