Lead Quality Engineer - Ai

Wolters Kluwer N.V

6 Locations
Base: $89,600.00 - $157,000.00 usd; bonus: eligibl...
**
Python testing frameworks pytest unittest
Ai evaluation frameworks llamaindex ragas trulens
Testing web applications and rest apis
** Wolters Kluwer is seeking a Lead AI Quality Engineer to enhance the quality and reliability of their AI-powered products in the Tax and Accounting sector. The role involves designing tests, developing automated solutions, and collaborating with teams to ensure the delivery of trustworthy systems. **

Job Summary

  • This hybrid role requires working 2 days a week in an office to ensure the quality and trustworthiness of AI-powered tax and accounting products.
  • The candidate will design evaluation harnesses to measure retrieval accuracy, citation correctness, and response alignment with user intent.
  • Wolters Kluwer offers competitive benefits including medical, dental, vision plans, 401(k), and paid parental leave alongside a salary range of $89,600.00 - $157,000.00 USD.

Matching Summary

Match Score: 75

** Wolters Kluwer is seeking a Lead AI Quality Engineer to enhance the quality and reliability of their AI-powered products in the Tax and Accounting sector. The role involves designing tests, developing automated solutions, and collaborating with teams to ensure the delivery of trustworthy systems. **

Salary

Base: $89,600.00 - $157,000.00 USD; Bonus: Eligible for Bonus; Benefits: Medical, Dental, Vision, 401(k), Tuition Assistance, Paid Parental Leave

Skills & Requirements

Must-have

  • Python testing frameworks Pytest unittest
  • AI evaluation frameworks LlamaIndex Ragas TruLens
  • Testing web applications and REST APIs
  • Designing evaluation harnesses for retrieval accuracy
  • Analyzing logs traces and feedback signals
  • Creating regression suites for prompt changes

Nice-to-have

  • Knowledge of RAG pipelines
  • Experience with Grafana Prometheus Datadog
  • Familiarity with Docker Kubernetes environments
  • Performance load testing tools Locust k6 JMeter
  • Strong analytical skills for non-deterministic outputs
  • Agile sprint planning and retrospectives participation

Key Requirements

  • Bachelors Degree in Computer Science or equivalent
  • 0.5+ years experience in software testing or quality engineering
  • Experience with AI/ML or non-deterministic system testing

Work Rights

Not specified

Tailored Resume

Cover Letter