Member Of Technical Staff, Evals & Post-training Product
aijobs Ltd
San Mateo, CA, United States
On-site
Llm evaluations and post-training methods
Product engineering across full-stack
Genai lifecycle understanding
Fireworks AI is seeking a Member of Technical Staff to enhance their evaluation and post-training product offerings. The role focuses on building workflows and tools that improve model evaluation and fine-tuning processes, requiring a strong background in software engineering and generative AI
Job Summary
This role sits at the intersection of product engineering, developer experience, and model quality, building products and workflows that connect evaluation and post-training into a continuous loop.
Key responsibilities include building internal eval workflows, owning fine-tuning product experiences, and working closely with users to understand needs and convert workflows into productized solutions.
The company is a Series C company valued at $4 billion, backed by top investors, and offers the opportunity to solve hard problems at the forefront of AI infrastructure.
Matching Summary
Match Score: 85
Fireworks AI is seeking a Member of Technical Staff to enhance their evaluation and post-training product offerings. The role focuses on building workflows and tools that improve model evaluation and fine-tuning processes, requiring a strong background in software engineering and generative AI.
Skills & Requirements
Must-have
LLM evaluations and post-training methods
Product engineering across full-stack
GenAI lifecycle understanding
Continuous evaluation and post-training loop
Open-source Eval Protocol SDK
Nice-to-have
Domain-specific evaluation experience
Open source contributions
Inference and hardware knowledge
Startup DNA
User-centric mindset
Key Requirements
1 - 7 years of software engineering experience
Hands-on experience with LLM evaluations and/or post-training methods