Member Of Technical Staff - Evaluations

Reflection AI

San Francisco, United States
On-site
Conduct critical comparative analysis
Build and refine evaluation systems
Develop generalizable evaluation frameworks
Our mission is to build open superintelligence and make it accessible to all

Job Summary

  • Our mission is to build open superintelligence and make it accessible to all.
  • Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior.
  • We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.

Matching Summary

Our mission is to build open superintelligence and make it accessible to all.

Skills & Requirements

Must-have

  • Conduct critical comparative analysis
  • Build and refine evaluation systems
  • Develop generalizable evaluation frameworks
  • Collaborate closely with applied teams
  • Push the boundaries of what's measurable

Nice-to-have

  • High agency and thrive in startup
  • Motivated by building feedback loops
  • Collaborative and detail-oriented

Key Requirements

  • Strong statistical analysis skills
  • Experimental design skills
  • Familiarity with LLM evaluation methodologies
  • Bias for impact over process

Work Rights

Not specified

Tailored Resume

Cover Letter