Research Engineer, Frontier Speculative Decoding

Together AI

San Francisco, United States
Base: $190,000 - $270,000; bonus/equity: startup e...
On-site
Python and pytorch programming experience
Hyperparameter search and tuning expertise
Data curation and processing skills
The role serves as a critical bridge between cutting-edge research and real-world applications by translating internal model training research into production-ready deployments

Job Summary

  • The role serves as a critical bridge between cutting-edge research and real-world applications by translating internal model training research into production-ready deployments.
  • Candidates will design and iterate on novel speculator algorithms to push the frontier of accuracy-efficiency tradeoffs while working with dedicated GPU clusters.
  • Together AI offers competitive compensation ranging from $190,000 to $270,000 plus equity and benefits for this high-impact position.

Matching Summary

The role serves as a critical bridge between cutting-edge research and real-world applications by translating internal model training research into production-ready deployments.

Salary

Base: $190,000 - $270,000; Bonus/Equity: Startup equity included; Benefits: Health insurance and other competitive benefits

Skills & Requirements

Must-have

  • Python and PyTorch programming experience
  • Hyperparameter search and tuning expertise
  • Data curation and processing skills
  • Model checkpoint evaluation proficiency
  • SLURM or Kubernetes cluster management

Nice-to-have

  • Experience with distributed training frameworks
  • Familiarity with modern LLMs and generative models
  • Collaboration with customer needs analysis
  • Deep technical ownership culture
  • Background in GPU cluster operations

Key Requirements

  • Bachelor's, Master's, or Ph.D. in Computer Science or related field
  • Equivalent practical experience in AI engineering roles
  • Proficiency in navigating complex codebases

Work Rights

Not specified

Tailored Resume

Cover Letter