Member Of Technical Staff - Model Evaluation

xAI

Palo Alto, CA, United States
Base: $180,000 - $440,000 usd; bonus/equity: not s...
On-site
Model assessment and evaluation task development
Public and in-house benchmarking
Collect and synthesize data for new evals
xAI is seeking a Member of Technical Staff specialized in model evaluation to assess AI systems and improve their quality. The role emphasizes hands-on contributions within a flat organizational structure, requiring strong communication and technical skills in model assessment

Job Summary

  • xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
  • Provide complete assessment of models, deep dive into model training and data to identify weakness points, and communicate with teams to improve model quality.
  • Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, and more.

Matching Summary

Match Score: 85

xAI is seeking a Member of Technical Staff specialized in model evaluation to assess AI systems and improve their quality. The role emphasizes hands-on contributions within a flat organizational structure, requiring strong communication and technical skills in model assessment.

Salary

Base: $180,000 - $440,000 USD; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • Model assessment and evaluation task development
  • Public and in-house benchmarking
  • Collect and synthesize data for new evals
  • Build infrastructure and framework for model evaluation
  • Familiarity with inference frameworks

Nice-to-have

  • Curiosity and drive for excellence
  • Flat organizational structure
  • Strong prioritization skills
  • Concise and accurate knowledge sharing

Key Requirements

  • Model assessment and evaluation task development
  • Inference frameworks like SGlang and vLLM

Work Rights

Not specified

Tailored Resume

Cover Letter