Tokens-as-a-service (taas) Software Engineer

OpenAI

San Francisco, United States
Remote
Strong software engineering background
Experience with distributed systems
Performance engineering skills
The role focuses on building systems that convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads

Job Summary

  • The role focuses on building systems that convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads.
  • Candidates will develop tooling to integrate external or partner infrastructure into OpenAI's internal compute, observability, and workload management systems.
  • The position requires identifying bottlenecks across hardware, networking, software, and workload enablement to ensure raw capacity becomes productive tokens.

Matching Summary

The role focuses on building systems that convert large-scale infrastructure capacity into measurable, reliable token throughput for OpenAI workloads.

Skills & Requirements

Must-have

  • Strong software engineering background
  • Experience with distributed systems
  • Performance engineering skills
  • Infrastructure platform development
  • Hardware and networking debugging

Nice-to-have

  • GPU cluster experience
  • AI infrastructure knowledge
  • Model porting familiarity
  • Token economics understanding
  • Billing and SLA monitoring

Key Requirements

  • Strong software engineering background
  • Experience in production operations
  • Ability to reason about token throughput

Work Rights

Not specified

Tailored Resume

Cover Letter