Senior Ai Infrastructure Engineer, Model Serving Platform

spacedefense.ai

San Francisco, CA, US
$216,200 - $270,250 usd; not specified; comprehens...
On-site
Backend system design
Llm serving and routing
Containers and orchestration tools
Build and maintain fault-tolerant, high-performance systems for serving LLMs workloads at scale

Job Summary

  • Build and maintain fault-tolerant, high-performance systems for serving LLMs workloads at scale.
  • Collaborate with researchers and engineers to integrate and optimize models for production and research use cases.
  • Compensation packages include base salary, equity, and benefits such as comprehensive health, dental and vision coverage, and retirement benefits.

Matching Summary

Build and maintain fault-tolerant, high-performance systems for serving LLMs workloads at scale.

Salary

$216,200 - $270,250 USD; Not specified; Comprehensive health, dental and vision coverage, retirement benefits, learning and development stipend, generous PTO, commuter stipend.

Skills & Requirements

Must-have

  • backend system design
  • LLM serving and routing
  • containers and orchestration tools
  • cloud infrastructure
  • infrastructure as code

Nice-to-have

  • modern LLM serving frameworks
  • ML fundamentals
  • highly collaborative environment
  • research and engineering integration

Key Requirements

  • 5+ years of experience
  • Strong programming skills
  • Experience with LLM capabilities
  • Proven ability to solve complex problems

Work Rights

Not specified

Tailored Resume

Cover Letter