This role involves designing and executing comprehensive testing strategies for advanced AI systems powering expert solutions in legal, tax, and compliance domains
Job Summary
This role involves designing and executing comprehensive testing strategies for advanced AI systems powering expert solutions in legal, tax, and compliance domains.
The company offers a flexible hybrid work model allowing 2-3 days in the office per week along with up to 8 weeks of work from anywhere annually.
Employees benefit from comprehensive plans including mental health resources, tuition reimbursement, two paid volunteer days, and a culture focused on continuous learning.
Matching Summary
This role involves designing and executing comprehensive testing strategies for advanced AI systems powering expert solutions in legal, tax, and compliance domains.
Skills & Requirements
Must-have
5+ years software quality assurance experience
2+ years testing AI/ML systems
Proficiency in Python and Java
Experience with Selenium and pytest
Knowledge of MLOps and LLMOps practices
Strong SQL and relational database skills
Experience with AWS, Azure, or GCP
Nice-to-have
Experience testing vector databases and embeddings
Familiarity with PyTorch or TensorFlow frameworks
Domain knowledge in legal or tax sectors
Portfolio demonstrating LLM testing expertise
Experience with OpenAI or Anthropic APIs
Knowledge of bias detection and fairness validation
Key Requirements
Bachelor's degree in Computer Science or equivalent
70% automation development and 30% manual testing split