Senior Ai Infrastructure Engineer

Together AI

Amsterdam, Netherlands
Hybrid (2 days onsite)
5+ years professional software development experience
High-performance production quality code
Globally distributed micro-service architectures
Together AI is seeking a Senior AI Infrastructure Engineer to help build their AI Acceleration Cloud platform, which focuses on high-performance infrastructure for generative AI workloads. The role requires expertise in backend programming, cloud architecture, and systems knowledge, with a hybrid work model based in Amsterdam

Job Summary

  • Together AI is building the AI Acceleration Cloud to combine the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.
  • The role involves designing and maintaining performant backend services that automate hardware management across dozens of global data centers.
  • Candidates must possess strong fundamental software development skills alongside excellent communication and collaboration abilities.

Matching Summary

Match Score: 85

Together AI is seeking a Senior AI Infrastructure Engineer to help build their AI Acceleration Cloud platform, which focuses on high-performance infrastructure for generative AI workloads. The role requires expertise in backend programming, cloud architecture, and systems knowledge, with a hybrid work model based in Amsterdam.

Skills & Requirements

Must-have

  • 5+ years professional software development experience
  • High-performance production quality code
  • Globally distributed micro-service architectures
  • Strong systems knowledge in compute networking storage

Nice-to-have

  • Deep Kubernetes internals experience
  • GPU virtualization and Infiniband expertise
  • Experience with DPUs and SmartNICs
  • Open-source platform contributions

Key Requirements

  • 5+ years of professional software development experience
  • Proficiency in at least one backend programming language
  • Experience with AWS Azure or GCP cloud providers

Work Rights

Not specified

Tailored Resume

Cover Letter