Engineering Manager, Inference Routing And Performance

Anthropic

San Francisco, CA, US
Base: $405,000 - $485,000 usd annually; bonus/equi...
On-site
5+ years engineering management experience
Deep systems background in load balancing
Experience shipping performance improvements
Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for society

Job Summary

  • Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for society.
  • The Engineering Manager will own the technical roadmap for cluster-level inference efficiency, including routing decisions and cache placement.
  • This role requires balancing the delivery of system-level performance improvements with running the team operationally to ensure safety and reliability.

Matching Summary

Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for society.

Salary

Base: $405,000 - $485,000 USD annually; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • 5+ years engineering management experience
  • Deep systems background in load balancing
  • Experience shipping performance improvements
  • Production infrastructure operational stakes
  • Quantitative performance modeling skills

Nice-to-have

  • Curiosity about machine learning systems
  • Experience with LLM inference serving
  • Background in cluster schedulers at scale
  • Familiarity with heterogeneous accelerator fleets
  • Led teams through rapid-growth periods

Key Requirements

  • Bachelor's degree or equivalent combination of education and training
  • 5+ years of engineering management experience
  • Proven track record leading critical-path production infrastructure at scale

Work Rights

Not specified

Tailored Resume

Cover Letter