Base: commensurate with experience; equity: meanin...
On-site
Ai-native testing of llm outputs
Build and own qa function from scratch
Design and implement testing frameworks
At Peach Pilot, we are building an enterprise AI operating system where trust is the product, ensuring every feature ships exactly as the user expects
Job Summary
At Peach Pilot, we are building an enterprise AI operating system where trust is the product, ensuring every feature ships exactly as the user expects.
This is a founding QA hire role where you will build and own the QA function, writing test code, designing eval pipelines, and setting the quality bar from the ground up.
You will have meaningful equity as a founding-team engineering hire and work directly with the founding engineering team, shaping the roadmap with your findings.
Matching Summary
At Peach Pilot, we are building an enterprise AI operating system where trust is the product, ensuring every feature ships exactly as the user expects.
Salary
Base: Commensurate with experience; Equity: Meaningful founding-team equity package; Benefits: Comprehensive medical, dental, and vision; 401(k); flexible PTO
Skills & Requirements
Must-have
AI-native testing of LLM outputs
Build and own QA function from scratch
Design and implement testing frameworks
Automated test suites for agent orchestration
Validate enterprise file ingestion pipeline
Test multi-model routing logic
Nice-to-have
Enterprise empathy for non-technical users
Quality architecture and team leadership
Build reusable test playbooks for field deployment