Director Of Product Management, Ai Evals

Harness

Mountain View, California, United States
Base: $265,000 - $280,000 annually; bonus/equity: ...
On-site
8+ years product management experience
Llm evaluation methodologies expertise
Ci/cd pipeline and developer workflow knowledge
This role defines the vision and strategy for Harness's AI Evals module to solve the bottleneck of evaluating LLM-powered systems in production

Job Summary

  • This role defines the vision and strategy for Harness's AI Evals module to solve the bottleneck of evaluating LLM-powered systems in production.
  • The position requires end-to-end business ownership including P&L, roadmap definition, and direct partnership with engineering and GTM teams.
  • Candidates must possess deep expertise in LLM evaluation methodologies and CI/CD pipelines to integrate evaluation seamlessly into software delivery workflows.

Matching Summary

This role defines the vision and strategy for Harness's AI Evals module to solve the bottleneck of evaluating LLM-powered systems in production.

Salary

Base: $265,000 - $280,000 annually; Bonus/Equity: Equity included; Benefits: Comprehensive healthcare, FSA, Flexible Time Off, Parental Leave

Skills & Requirements

Must-have

  • 8+ years product management experience
  • LLM evaluation methodologies expertise
  • CI/CD pipeline and developer workflow knowledge
  • AI observability and quality assurance understanding
  • Agentic AI systems evaluation challenges

Nice-to-have

  • Experience building AI evaluation platforms at scale
  • Prompt engineering and fine-tuning pipeline familiarity
  • Dataset versioning and AI governance exposure
  • Automated remediation framework knowledge
  • Cloud-native enterprise SaaS background

Key Requirements

  • 8+ years of product management experience
  • Proven track record owning business outcomes and revenue impact
  • Strong stakeholder management across product, engineering, and sales teams

Work Rights

Not specified

Tailored Resume

Cover Letter