Senior Engineer, Inference Data Plane

DigitalOcean

Boston, United States
Base: $139,200.00 - $174,000.00; bonus/equity: eli...
On-site
Deep experience with distributed systems
Expert proficiency in golang or python
Proven experience building gen ai platforms
This role involves driving the design and development of distributed services within the AI Infrastructure ecosystem, specifically focusing on orchestration for LLM inference

Job Summary

  • This role involves driving the design and development of distributed services within the AI Infrastructure ecosystem, specifically focusing on orchestration for LLM inference.
  • The successful candidate will bridge the gap between high-scale distributed systems and specialized AI inference orchestration to ensure a simple, reliable platform.
  • DigitalOcean offers competitive compensation including base salary, potential bonuses, equity grants, and access to LinkedIn Learning for continuous professional growth.

Matching Summary

This role involves driving the design and development of distributed services within the AI Infrastructure ecosystem, specifically focusing on orchestration for LLM inference.

Salary

Base: $139,200.00 - $174,000.00; Bonus/Equity: Eligible for bonus based on performance and equity grants upon hire; Benefits: Competitive array including flexible time off and EAP

Skills & Requirements

Must-have

  • Deep experience with distributed systems
  • Expert proficiency in GoLang or Python
  • Proven experience building Gen AI platforms
  • Advanced knowledge of Kubernetes and cloud networking
  • Significant experience running high-availability services

Nice-to-have

  • Deep networking software experience including RDMA
  • Familiarity with gRPC for service communication
  • Experience integrating open-source software
  • Bias for technical ownership and action
  • Knowledge of L3-L7 network protocols

Key Requirements

  • Senior level engineering experience
  • Expert proficiency in GoLang or Python
  • Background in AI/ML product development
  • Track record of operating multi-region services

Work Rights

Not specified

Tailored Resume

Cover Letter