Qa Automation Engineer (ai Systems & Web Apps)

Talkspace

New York, United States
On-site
Automated test script development
Web, mobile, api, llm testing
Agentic workflow testing
Build and maintain automated and manual testing frameworks for web, mobile, API, and LLM-powered systems

Job Summary

  • Build and maintain automated and manual testing frameworks for web, mobile, API, and LLM-powered systems.
  • Develop evaluation harnesses for LLM outputs, including structured output validation and model regression testing.
  • Comprehensive Medical, Dental and Vision plans coverage since day one, along with a Monthly Wellness Stipend.

Matching Summary

Build and maintain automated and manual testing frameworks for web, mobile, API, and LLM-powered systems.

Skills & Requirements

Must-have

  • Automated test script development
  • Web, mobile, API, LLM testing
  • Agentic workflow testing
  • Structured output validation
  • Model regression testing
  • CI/CD pipeline familiarity

Nice-to-have

  • Fostering inclusive workplace
  • Improving QA efficiency
  • Continuous improvement efforts

Key Requirements

  • 3+ years QA automation experience
  • BA/BS in Computer Science
  • Experience with Cypress, Playwright, Selenium
  • Experience with SQL, API testing, JSON
  • Experience testing AI/LLM-driven systems preferred

Work Rights

Not specified

Tailored Resume

Cover Letter