Backend Engineer - Api

xAI

Palo Alto, CA, United States
Base: $180,000 - $440,000 usd; bonus/equity: equit...
On-site
Expert knowledge of rust or c++
Designing horizontally scalable distributed systems
Experience with postgresql, clickhouse, mongodb
xAI is seeking a Backend Engineer with a strong background in building scalable and reliable production infrastructure, primarily using Rust or C++. The position involves developing an API for high-throughput inference and requires a hands-on approach within a flat organizational structure that emphasizes initiative and communication

Job Summary

  • xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
  • The role involves owning the end-to-end system responsible for high-throughput inference handling billions of tokens per minute with low latency.
  • Total rewards include a base salary ranging from $180,000 to $440,000 USD plus equity and comprehensive medical benefits.

Matching Summary

Match Score: 85

xAI is seeking a Backend Engineer with a strong background in building scalable and reliable production infrastructure, primarily using Rust or C++. The position involves developing an API for high-throughput inference and requires a hands-on approach within a flat organizational structure that emphasizes initiative and communication.

Salary

Base: $180,000 - $440,000 USD; Bonus/Equity: Equity included; Benefits: Comprehensive medical, vision, dental, 401(k), disability, life insurance

Skills & Requirements

Must-have

  • Expert knowledge of Rust or C++
  • Designing horizontally scalable distributed systems
  • Experience with PostgreSQL, Clickhouse, MongoDB

Nice-to-have

  • Experience with LLM inference engines like vLLM
  • Knowledge of agent SDKs and orchestration frameworks
  • Expert knowledge of gRPC streaming protocols

Key Requirements

  • Expert knowledge of either Rust or C++
  • Experience operating commonly used databases
  • Not specified

Work Rights

Not specified

Tailored Resume

Cover Letter