Machine Learning Engineer, Llm Evals & Observability

Glean

San Francisco, CA, United States
Base: $200,000 - $300,000 annually; bonus/equity: ...
On-site
2+ years software engineering experience
Strong backend fundamentals in go and python
Experience with llm evaluation and rlhf
The role focuses on building the measurement and quality layer that makes Glean's AI Assistant and Agents reliably better over time

Job Summary

  • The role focuses on building the measurement and quality layer that makes Glean's AI Assistant and Agents reliably better over time.
  • Candidates will design evaluation datasets, build large-scale pipelines, and create LLM-powered judges to score response quality.
  • The position offers a competitive base salary range of $200,000 to $300,000 annually along with comprehensive benefits.

Matching Summary

The role focuses on building the measurement and quality layer that makes Glean's AI Assistant and Agents reliably better over time.

Salary

Base: $200,000 - $300,000 annually; Bonus/Equity: Eligible for variable compensation and equity; Benefits: Medical, Vision, Dental, 401k, generous time-off

Skills & Requirements

Must-have

  • 2+ years software engineering experience
  • Strong backend fundamentals in Go and Python
  • Experience with LLM evaluation and RLHF
  • Distributed data pipeline expertise
  • Analytical rigor in offline metrics

Nice-to-have

  • Customer-focused team player
  • Deep care for product quality
  • Cross-functional collaboration skills
  • Automated prompt iteration techniques

Key Requirements

  • 2+ years of software engineering experience
  • Proficiency in Go and Python programming
  • Experience with machine learning systems

Work Rights

Not specified

Tailored Resume

Cover Letter