Senior Software Engineer Ii, Inference

CoreWeave

Sunnyvale, CA, US
$165,000 to $242,000; bonus/equity: discretionary ...
On-site
Kubernetes-native inference platform
Optimize ml system performance
Cuda kernels and accelerators
Senior engineers lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services

Job Summary

  • Senior engineers lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services.
  • You will partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.
  • CoreWeave offers a comprehensive benefits program including 100% paid medical, dental, and vision insurance, a 401(k) with employer match, and flexible PTO.

Matching Summary

Senior engineers lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services.

Salary

$165,000 to $242,000; Bonus/Equity: Discretionary bonus, equity awards; Benefits: Comprehensive benefits program

Skills & Requirements

Must-have

  • Kubernetes-native inference platform
  • Optimize ML system performance
  • CUDA kernels and accelerators
  • Distributed systems and cloud services
  • Production scale Kubernetes experience
  • Inference internals knowledge

Nice-to-have

  • Entrepreneurial outlook and independent thinking
  • Collaborative and innovative problem-solving
  • Mentoring junior engineers
  • Customer partnership experience

Key Requirements

  • 5-8 years industry experience
  • Python or Go coding proficiency
  • Production scale Kubernetes
  • ML system performance optimization
  • Inference internals practical knowledge

Work Rights

Must be a U.S. person (U.S. citizen, lawful permanent resident, refugee, or asylee)

Tailored Resume

Cover Letter