Research Scientist, Agent Robustness

Scale

San Francisco, CA, US
Base: $197,400 - $246,750 usd; bonus/equity: equit...
On-site
Research ai agent capabilities
Design evaluation harnesses
Build agent scaffolding
Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities

Job Summary

  • Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.
  • As a Research Scientist working on Agent Robustness you will work on the fundamental challenges of building AI agents that are safe and aligned with humans.
  • Our research interviews are crafted to assess candidates' skills in practical ML prototyping and debugging, their grasp of research concepts, and their alignment with our organizational culture.

Matching Summary

Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities.

Salary

Base: $197,400 - $246,750 USD; Bonus/Equity: Equity compensation subject to Board approval; Benefits: Comprehensive health, dental, vision, retirement, learning stipend, PTO, commuter stipend

Skills & Requirements

Must-have

  • research AI agent capabilities
  • design evaluation harnesses
  • build agent scaffolding
  • RLHF, DPO, GRPO techniques
  • published research in machine learning
  • addressing sophisticated ML problems

Nice-to-have

  • agent evaluation frameworks experience
  • red-teaming AI systems
  • prompt injection experience
  • adversarial testing AI systems

Key Requirements

  • At least three years of experience
  • Commitment to promoting safe AI deployments
  • Practical experience conducting technical research collaboratively
  • Experience with post-training and RL techniques
  • Track record of published research
  • Strong written and verbal communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter