Senior Ai Infrastructure Engineer - Training Platform

get-gravity.ai

San Francisco, CA, US
Base: $216,000 - $270,000 usd; equity: subject to ...
On-site
5+ years backend or infrastructure engineering experience
2+ years orchestrating ml workloads at scale
Expert-level kubernetes internals knowledge
The role involves building the operating system for large-scale GPU clusters to handle immense multi-thousand GPU workloads efficiently

Job Summary

  • The role involves building the operating system for large-scale GPU clusters to handle immense multi-thousand GPU workloads efficiently.
  • Candidates will partner closely with researchers to create a resilient environment that transforms raw compute into breakthrough AI models.
  • Compensation includes a base salary range of $216,000 to $270,000 USD along with equity, comprehensive health benefits, and a learning stipend.

Matching Summary

The role involves building the operating system for large-scale GPU clusters to handle immense multi-thousand GPU workloads efficiently.

Salary

Base: $216,000 - $270,000 USD; Equity: Subject to Board approval; Benefits: Comprehensive health, dental, vision, retirement, PTO, and learning stipend

Skills & Requirements

Must-have

  • 5+ years backend or infrastructure engineering experience
  • 2+ years orchestrating ML workloads at scale
  • Expert-level Kubernetes internals knowledge
  • Experience with distributed storage systems like Lustre or S3
  • Strong programming skills in Python, Go, Rust, or C++

Nice-to-have

  • Experience with DeepSpeed or FSDP distributed training techniques
  • Familiarity with NVIDIA CUDA and NCCL software stacks
  • Knowledge of PyTorch framework
  • Experience with Reinforcement Learning algorithms like GRPO
  • Infrastructure as code proficiency using Terraform

Key Requirements

  • 5+ years of backend or infrastructure engineering experience
  • 2+ years focused on orchestrating ML workloads at scale
  • Expert-level knowledge of Kubernetes internals and device plugins

Work Rights

Not specified

Tailored Resume

Cover Letter