Member Of Technical Staff, Evals & Post-training Product

Fireworks

San Mateo, CA, United States
On-site
Llm evaluations and post-training methods
Product engineering across stack
Genai lifecycle understanding
Fireworks is seeking a Member of Technical Staff for their Evals & Post-training Product team to enhance model quality through developing evaluation workflows and user-centric products. The role requires software engineering experience, particularly with LLM evaluations and product engineering skills, and offers opportunities to work with cutting-edge AI technology in a fast-paced environment

Job Summary

  • We are seeking a Member of Technical Staff, Evals & Post-Training Product to help define how developers improve models on Fireworks.
  • You will build the products and workflows that connect evaluation and post-training into a continuous loop, helping internal teams run evals at scale and enabling external developers through our open-source Eval Protocol SDK.
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.

Matching Summary

Match Score: 85

Fireworks is seeking a Member of Technical Staff for their Evals & Post-training Product team to enhance model quality through developing evaluation workflows and user-centric products. The role requires software engineering experience, particularly with LLM evaluations and product engineering skills, and offers opportunities to work with cutting-edge AI technology in a fast-paced environment.

Skills & Requirements

Must-have

  • LLM evaluations and post-training methods
  • Product engineering across stack
  • GenAI lifecycle understanding
  • User-centric mindset
  • Software engineering experience

Nice-to-have

  • Domain-specific evaluation experience
  • Open source contributions
  • Inference and hardware knowledge
  • Startup DNA

Key Requirements

  • 1 - 7 years of software engineering experience
  • Hands-on experience with LLM evaluations and/or post-training methods
  • Product Engineering Skills
  • Understanding of the GenAI Lifecycle
  • User-Centric Mindset

Work Rights

Not specified

Tailored Resume

Cover Letter