Senior Engineer, Inference Data Plane

DigitalOcean

Seattle, United States
Base: $139,200.00 - $174,000.00; bonus/equity: eli...
On-site
Distributed systems architecture experience
Golang or python programming proficiency
Kubernetes containerization expertise
This role involves driving the design of distributed services for the AI Infrastructure ecosystem, specifically focusing on LLM inference orchestration

Job Summary

  • This role involves driving the design of distributed services for the AI Infrastructure ecosystem, specifically focusing on LLM inference orchestration.
  • The team is responsible for operating compute fleet, storage, and networking to support Gen AI model hosting infrastructure at a global scale.
  • DigitalOcean offers competitive compensation including base salary, performance bonuses, equity grants, and access to LinkedIn Learning for career development.

Matching Summary

This role involves driving the design of distributed services for the AI Infrastructure ecosystem, specifically focusing on LLM inference orchestration.

Salary

Base: $139,200.00 - $174,000.00; Bonus/Equity: Eligible for bonus and equity grants; Benefits: Flexible time off, EAP, conference reimbursement

Skills & Requirements

Must-have

  • Distributed systems architecture experience
  • GoLang or Python programming proficiency
  • Kubernetes containerization expertise
  • High-scale cloud networking knowledge
  • LLM hosting and inference workflows

Nice-to-have

  • Deep networking software experience with RDMA
  • Open source software integration background
  • Bias for technical ownership culture
  • Experience with AI coding agents

Key Requirements

  • Expert proficiency in GoLang or Python
  • Significant experience running high-availability services
  • Advanced knowledge of cloud networking protocols

Work Rights

Not specified

Tailored Resume

Cover Letter