Senior Engineer, Inference Data Plane

DigitalOcean

Denver, United States
Base: $139,200.00 - $174,000.00; bonus/equity: eli...
On-site
Deep experience with distributed systems
Expert proficiency in golang or python
Proven experience with kubernetes and cloud networking
The role involves driving the design and development of distributed services within the AI Infrastructure ecosystem for high-scale LLM inference

Job Summary

  • The role involves driving the design and development of distributed services within the AI Infrastructure ecosystem for high-scale LLM inference.
  • Candidates must possess deep expertise in cloud networking, containerization, and storage to ensure platform reliability and resiliency.
  • DigitalOcean offers competitive compensation including base salary, performance bonuses, equity grants, and access to extensive learning resources.

Matching Summary

The role involves driving the design and development of distributed services within the AI Infrastructure ecosystem for high-scale LLM inference.

Salary

Base: $139,200.00 - $174,000.00; Bonus/Equity: Eligible for bonus based on performance and equity grants upon hire; Benefits: Flexible time off, EAP, conference reimbursement, LinkedIn Learning access

Skills & Requirements

Must-have

  • Deep experience with distributed systems
  • Expert proficiency in GoLang or Python
  • Proven experience with Kubernetes and cloud networking
  • Background in Gen AI platforms and LLM hosting
  • Experience defining SLOs and observability strategies

Nice-to-have

  • Familiarity with AI coding agents
  • Knowledge of RDMA and advanced network protocols
  • Open source software integration experience
  • Bias for technical ownership and action
  • Experience with multi-tenant cloud ecosystems

Key Requirements

  • Significant experience running customer-facing high-availability services
  • Advanced knowledge of cloud networking and containerization
  • Expert proficiency in GoLang or Python programming

Work Rights

Not specified

Tailored Resume

Cover Letter