Research Scientist, Frontier Risk Evaluations

Scale

San Francisco, CA, USA
$197,400—$246,750 usd; not specified; comprehensiv...
On-site
Design evaluation measures harnesses datasets
Testing ai models for dangerous capabilities
Collaborate with government agencies
Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities

Job Summary

  • Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.
  • As a Research Scientist focused on Frontier Risk Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks posed by frontier AI systems.
  • Compensation packages at Scale for eligible roles include base salary, equity, and benefits.

Matching Summary

Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.

Salary

$197,400—$246,750 USD; Not specified; Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO.

Skills & Requirements

Must-have

  • design evaluation measures harnesses datasets
  • testing AI models for dangerous capabilities
  • collaborate with government agencies
  • publish evaluation methodologies
  • practical technical research experience
  • building and instrumenting ML pipelines
  • writing evaluation harnesses
  • track record of published research ML
  • generative AI expertise
  • addressing sophisticated ML problems
  • strong written verbal communication

Nice-to-have

  • crafting evaluations and benchmarks
  • data science LLM technologies
  • red-teaming or adversarial testing
  • AI safety policy frameworks

Key Requirements

  • at least three years of experience
  • Commitment to mission of promoting safe AI

Work Rights

Not specified

Tailored Resume

Cover Letter