Senior Engineer Ii, Gpu Kernel And Performance

DigitalOcean

San Francisco, United States
Base: $167,200.00 to $209,000; bonus/equity: eligi...
On-site
Expert-level triton or cuda programming
Deep understanding of gpu architectures
Optimizing kernels to >80% peak performance
DigitalOcean is seeking a Senior Engineer to ensure industry-leading performance for their inference services by maximizing throughput and minimizing latency

Job Summary

  • DigitalOcean is seeking a Senior Engineer to ensure industry-leading performance for their inference services by maximizing throughput and minimizing latency.
  • The role involves designing high-performance GPU kernels using Triton and CUDA C++ while implementing state-of-the-art quantization techniques like FP8 and INT8.
  • Employees benefit from competitive compensation including base salary, bonuses, equity grants, and access to LinkedIn Learning's extensive course library.

Matching Summary

DigitalOcean is seeking a Senior Engineer to ensure industry-leading performance for their inference services by maximizing throughput and minimizing latency.

Salary

Base: $167,200.00 to $209,000; Bonus/Equity: Eligible for bonus based on performance and equity grants upon hire; Benefits: Competitive array including flexible time off and EAP

Skills & Requirements

Must-have

  • Expert-level Triton or CUDA programming
  • Deep understanding of GPU architectures
  • Optimizing kernels to >80% peak performance
  • Strong grasp of linear algebra mapping
  • Experience with FlashAttention-4 implementation

Nice-to-have

  • Contributions to the Triton compiler
  • Custom CUDA kernels for major LLMs
  • Growth mindset and bold thinking
  • Fast-paced industry disruptor environment
  • Bias for action and ownership

Key Requirements

  • Track record of optimizing kernels to >80% theoretical hardware peak performance
  • Expert-level proficiency in Triton or CUDA
  • Deep understanding of SMs, Warp scheduling, and Tensor Cores

Work Rights

Not specified

Tailored Resume

Cover Letter