Machine Learning Engineer

Together AI

San Francisco, United States
Base: $160,000 - $220,000; bonus/equity: startup e...
On-site
5+ years high-performance production code experience
Expert level python, go, rust, or c/c++ programming
Experience with llm inference frameworks like vllm sglang trt
Together AI is seeking an ML Engineer to develop systems enabling customers to perform inference and fine-tune LLMs

Job Summary

  • Together AI is seeking an ML Engineer to develop systems enabling customers to perform inference and fine-tune LLMs.
  • The role involves designing production systems that power the Together Cloud inference and fine-tuning APIs with a focus on reliability and performance.
  • Candidates will benefit from competitive compensation including startup equity, health insurance, and a salary range of $160,000 - $220,000.

Matching Summary

Together AI is seeking an ML Engineer to develop systems enabling customers to perform inference and fine-tune LLMs.

Salary

Base: $160,000 - $220,000; Bonus/Equity: Startup equity included; Benefits: Health insurance and other competitive benefits

Skills & Requirements

Must-have

  • 5+ years high-performance production code experience
  • Expert level Python, Go, Rust, or C/C++ programming
  • Experience with LLM inference frameworks like vLLM SGLang TRT
  • Building large-scale fault-tolerant distributed systems
  • Implementing runtime inference services at scale

Nice-to-have

  • Partnering with researchers and product managers
  • Conducting design and code reviews
  • Creating developer documentation and testing frameworks
  • Participating in on-call rotation for critical incidents

Key Requirements

  • Bachelor's degree in computer science or equivalent industry experience
  • 5+ years of experience writing production quality code
  • Expert proficiency in Python, Go, Rust, or C/C++

Work Rights

Not specified

Tailored Resume

Cover Letter