Senior Ai Infrastructure Engineer, Model Serving Platform

get-gravity.ai

San Francisco, CA, US
$216,200 - $270,250 usd; not specified; comprehens...
On-site
Build fault-tolerant high-performance systems
Design and build scalable reliable efficient platforms
Llm serving and routing fundamentals
Design and build platforms for scalable, reliable, and efficient serving of LLMs

Job Summary

  • Design and build platforms for scalable, reliable, and efficient serving of LLMs.
  • Build and maintain fault-tolerant, high-performance systems for serving LLMs workloads at scale.
  • Compensation packages include base salary, equity, and benefits such as comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO.

Matching Summary

Design and build platforms for scalable, reliable, and efficient serving of LLMs.

Salary

$216,200 - $270,250 USD; Not specified; Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO.

Skills & Requirements

Must-have

  • Build fault-tolerant high-performance systems
  • Design and build scalable reliable efficient platforms
  • LLM serving and routing fundamentals
  • Containers and orchestration tools
  • Cloud infrastructure and infrastructure as code

Nice-to-have

  • Modern LLM serving frameworks
  • Collaborative research and engineering environment
  • Bridge research and engineering
  • Solve complex problems independently

Key Requirements

  • 5+ years backend systems experience
  • Strong programming skills
  • Experience with LLM capabilities and concepts
  • Work authorization not specified

Work Rights

Not specified

Tailored Resume

Cover Letter