Research Scientist, Frontier Risk Evaluations

get-gravity.ai

San Francisco, CA, USA
Base: $197,400 - $246,750 usd; equity: subject to ...
On-site
Design and build evaluation harnesses
Collaborate with government agencies
Publish evaluation methodologies
Scale Labs has launched a new team focused on policy research to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities

Job Summary

  • Scale Labs has launched a new team focused on policy research to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.
  • As a Research Scientist focused on Frontier Risk Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks posed by frontier AI systems.
  • Compensation packages at Scale for eligible roles include base salary, equity, and benefits, with a base salary range of $197,400 - $246,750 USD for this full-time position in San Francisco, New York, Seattle.

Matching Summary

Scale Labs has launched a new team focused on policy research to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.

Salary

Base: $197,400 - $246,750 USD; Equity: Subject to Board of Director approval; Benefits: Comprehensive health, dental and vision coverage, retirement benefits, learning and development stipend, generous PTO, commuter stipend eligibility

Skills & Requirements

Must-have

  • design and build evaluation harnesses
  • collaborate with government agencies
  • publish evaluation methodologies
  • practical technical research experience
  • building and instrumenting ML pipelines
  • writing evaluation harnesses
  • turning research into prototypes

Nice-to-have

  • crafting evaluations and benchmarks
  • data science for LLM technologies
  • red-teaming or adversarial testing
  • familiarity with AI safety policy frameworks

Key Requirements

  • at least three years of experience
  • track record of published research
  • strong written and verbal communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter