Staff Machine Learning Engineer, Ai Serving

Reddit

Remote, US
Base: $253,300 - $354,600 usd; bonus/equity: eligi...
Remote
7+ years ml engineering experience
Kubernetes orchestration at scale
Python and go programming proficiency
The Machine Learning Platform team owns the infrastructure powering recommendations, content discovery, and user quantification across Reddit

Job Summary

  • The Machine Learning Platform team owns the infrastructure powering recommendations, content discovery, and user quantification across Reddit.
  • This role involves leading the end-to-end design of a highly available, low-latency GPU-based model serving system supporting millions of QPS.
  • Candidates will benefit from comprehensive healthcare, 401k matching, gender-affirming care, and generous paid parental leave.

Matching Summary

The Machine Learning Platform team owns the infrastructure powering recommendations, content discovery, and user quantification across Reddit.

Salary

Base: $253,300 - $354,600 USD; Bonus/Equity: Eligible for restricted stock units; Benefits: Comprehensive healthcare, 401k match, paid time off

Skills & Requirements

Must-have

  • 7+ years ML Engineering experience
  • Kubernetes orchestration at scale
  • Python and Go programming proficiency
  • AWS or Google Cloud infrastructure
  • GPU model serving and optimization

Nice-to-have

  • Experience with LLM serving online
  • Knowledge of Triton, Dynamo, vLLM
  • Strong communication with non-technical stakeholders
  • Deep understanding of multi-cluster network topology
  • E2E inference performance benchmarking framework

Key Requirements

  • 7+ years in ML Engineering or AI Platform roles
  • Proficiency in Python and Go languages
  • Deep experience with Kubernetes and cloud technologies

Work Rights

Not specified

Tailored Resume

Cover Letter