Staff Backend Software Engineer

Databricks

New York, United States
$190,000—$261,250 usd py
On-site
Backend or infrastructure engineering
Scala, go, or python
Distributed systems
Build LLM infrastructure powering trillions of tokens per week for customers through partner models and self-hosted models

Job Summary

  • Build LLM infrastructure powering trillions of tokens per week for customers through partner models and self-hosted models.
  • Improve reliability, latency, and efficiency of distributed AI workloads and collaborate with platform, infra, and ML teams.
  • Shape how developers and data scientists build and interact with AI on Databricks, joining a high-agency, high-visibility team operating at the frontier of AI infrastructure.

Matching Summary

Build LLM infrastructure powering trillions of tokens per week for customers through partner models and self-hosted models.

Salary

$190,000—$261,250 USD

Skills & Requirements

Must-have

  • backend or infrastructure engineering
  • Scala, Go, or Python
  • distributed systems
  • scalable APIs
  • cloud-native infrastructure
  • service-oriented architecture
  • deployment pipelines
  • system observability

Nice-to-have

  • real-time serving
  • ML infrastructure
  • GPU orchestration
  • developer platforms
  • internal tools supporting AI workflows

Key Requirements

  • 8+ years of experience
  • Strong programming skills
  • Experience with distributed systems
  • Familiarity with SOA
  • Product and ownership mindset

Work Rights

Not specified

Tailored Resume

Cover Letter