Senior Engineer Ii, Ai Inference Engine Systems

DigitalOcean

Boston, United States
Base: $167,200.00 - $209,000; bonus/equity: eligib...
On-site
Distributed systems expertise
Ai model hosting experience
Golang or python proficiency
The role involves acting as a technical leader to design and deliver critical data plane components for large generative AI models

Job Summary

  • The role involves acting as a technical leader to design and deliver critical data plane components for large generative AI models.
  • Candidates must possess hands-on experience hosting large language models using inference engines like vLLM, SGLang, or Modular.
  • DigitalOcean offers competitive compensation including base salary, potential bonuses, equity grants, and access to LinkedIn Learning resources.

Matching Summary

The role involves acting as a technical leader to design and deliver critical data plane components for large generative AI models.

Salary

Base: $167,200.00 - $209,000; Bonus/Equity: Eligible for bonus based on performance and equity grants upon hire; Benefits: Competitive array including flexible time off and EAP

Skills & Requirements

Must-have

  • Distributed systems expertise
  • AI model hosting experience
  • GoLang or Python proficiency
  • GPU optimization knowledge
  • High-scale service operations

Nice-to-have

  • Mentorship of junior engineers
  • Open source software mindset
  • Cross-functional collaboration skills
  • Experience with AI coding agents

Key Requirements

  • Expert-level proficiency in GoLang or Python
  • Strong background in microservices and infrastructure as code
  • Proven experience shipping customer-facing software products

Work Rights

Not specified

Tailored Resume

Cover Letter