Senior Ai Infrastructure Engineer, Model Serving Platform

Mo Ai Jobs

San Francisco, CA, US
$216,200—$270,250 usd; not specified; comprehensiv...
On-site
Backend system design
Scalable, reliable, efficient serving
Llm serving and routing
As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs

Job Summary

  • As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs.
  • You’ll work in a highly collaborative environment, bridging research and engineering to deliver seamless experiences to our customers and accelerate innovation across the company.
  • Compensation packages at Scale for eligible roles include base salary, equity, and benefits.

Matching Summary

As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs.

Salary

$216,200—$270,250 USD; Not specified; Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO.

Skills & Requirements

Must-have

  • backend system design
  • scalable, reliable, efficient serving
  • LLM serving and routing
  • containers and orchestration tools
  • cloud infrastructure

Nice-to-have

  • modern LLM serving frameworks
  • ML fundamentals
  • research and production systems
  • cross-functional environment

Key Requirements

  • 5+ years of experience
  • Strong programming skills
  • Experience with LLM capabilities
  • Infrastructure as code experience

Work Rights

Not specified

Tailored Resume

Cover Letter