Backend Engineer - Api

xAI

Palo Alto, CA, United States
Base: $180,000 - $440,000 usd; bonus/equity: equit...
On-site
Expert knowledge of rust or c++
Designing horizontally scalable distributed systems
Experience with postgresql, clickhouse, and mongodb
xAI is seeking a Backend Engineer to develop a highly scalable API that serves AI models globally, primarily using Rust or C++. The ideal candidate should be experienced in designing distributed systems and possess strong communication skills to thrive in a flat organizational culture

Job Summary

  • xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
  • The role involves owning the end-to-end system responsible for high-throughput inference handling billions of tokens per minute.
  • Total rewards include base salary ranging from $180,000 to $440,000 USD plus equity and comprehensive benefits.

Matching Summary

Match Score: 85

xAI is seeking a Backend Engineer to develop a highly scalable API that serves AI models globally, primarily using Rust or C++. The ideal candidate should be experienced in designing distributed systems and possess strong communication skills to thrive in a flat organizational culture.

Salary

Base: $180,000 - $440,000 USD; Bonus/Equity: Equity included; Benefits: Medical, vision, dental, 401(k), disability, life insurance

Skills & Requirements

Must-have

  • Expert knowledge of Rust or C++
  • Designing horizontally scalable distributed systems
  • Experience with PostgreSQL, Clickhouse, and MongoDB

Nice-to-have

  • Experience with LLM inference engines like vLLM
  • Knowledge of agent SDKs and orchestration frameworks
  • Expert knowledge of gRPC streaming protocols

Key Requirements

  • Expert knowledge of either Rust or C++
  • Experience operating commonly used databases such as PostgreSQL
  • Knowledge of service observability and reliability best practices

Work Rights

Not specified

Tailored Resume

Cover Letter