Designing horizontally scalable distributed systems
Experience with postgresql clickhouse mongodb
xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge
Job Summary
xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
The role involves owning the end-to-end system responsible for high-throughput inference handling billions of tokens per minute with low latency.
The team operates with a flat organizational structure where all employees are expected to be hands-on and contribute directly to the company's mission.
Matching Summary
xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
Skills & Requirements
Must-have
Expert knowledge of Rust or C++
Designing horizontally scalable distributed systems
Experience with PostgreSQL Clickhouse MongoDB
Nice-to-have
Experience with LLM inference engines like vLLM
Knowledge of gRPC streaming protocols
Familiarity with Docker and Kubernetes
Key Requirements
Expert knowledge of either Rust or C++
Experience operating databases such as PostgreSQL and MongoDB