Qa & Testing Senior Analyst - Hih - Evernorth

Express Scripts

Hyderabad, India
Gen ai and agentic ai testing
Azure openai llm output validation
Aws data pipeline testing
This role ensures the quality, reliability, and compliance of Gen AI and Agentic AI solutions within Evernorth Health Services India

Job Summary

  • This role ensures the quality, reliability, and compliance of Gen AI and Agentic AI solutions within Evernorth Health Services India.
  • The position involves designing test plans for AI/ML models and validating outputs from Azure OpenAI LLMs for accuracy, relevance, and bias.
  • Candidates will collaborate with architects and data scientists to integrate AI components seamlessly with HR systems like ServiceNow and Workday.

Matching Summary

This role ensures the quality, reliability, and compliance of Gen AI and Agentic AI solutions within Evernorth Health Services India.

Skills & Requirements

Must-have

  • Gen AI and Agentic AI testing
  • Azure OpenAI LLM output validation
  • AWS data pipeline testing
  • PyTest and Selenium automation
  • Prompt finetuning and hyperparameter tuning
  • LLM fairness and bias evaluation
  • ServiceNow and Workday integration testing

Nice-to-have

  • MLOps and automated model validation pipelines
  • Azure cloud platform certification
  • Agile development and QA methodologies
  • Strong communication and collaboration skills
  • Experience with generative AI solutions

Key Requirements

  • Bachelor's degree in Computer Science or related field
  • 2+ years experience in software, AI/ML, or cloud testing
  • Proficiency in PyTest and Selenium frameworks
  • Understanding of data quality and privacy compliance

Work Rights

Not specified

Tailored Resume

Cover Letter