Senior Software Engineer - Together Cloud Platform

Togetherai

San Francisco, United States
Base: $160,000 - $230,000; bonus/equity: equity; b...
On-site
Building large scale distributed systems
Api microservices
Distributed gpu scheduling system
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure

Job Summary

  • Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.
  • As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware.
  • We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work.

Matching Summary

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

Salary

Base: $160,000 - $230,000; Bonus/Equity: equity; Benefits: health insurance, other benefits

Skills & Requirements

Must-have

  • building large scale distributed systems
  • API microservices
  • distributed GPU scheduling system
  • global management plane
  • customer-facing cloud platform services
  • robustness and scalability analysis
  • Golang programming language

Nice-to-have

  • building and operating data infrastructure
  • research-driven artificial intelligence company
  • open and transparent AI systems

Key Requirements

  • 5+ years of experience
  • Bachelor’s or Master’s degree
  • Experience with Kubernetes and containers preferred
  • Experience building and operating data infrastructure a plus

Work Rights

Not specified

Tailored Resume

Cover Letter