Senior Machine Learning Engineer (intellij Ai)

Jetbrains

Amsterdam, Netherlands
**
Design evaluation frameworks
Diagnose model performance issues
Experiment with contexts and models
** JetBrains is seeking a Senior Machine Learning Engineer to enhance AI capabilities across their IDEs. The ideal candidate will have extensive experience in machine learning systems, specifically with LLMs, and will work collaboratively with product teams to implement and optimize AI features. **

Job Summary

  • Join the ML subteam within IntelliJ AI, driving the development of our ML system from end to end by defining evaluation and metrics, shaping context orchestration, and helping product teams tailor AI capabilities to their needs.
  • Design and drive evaluation frameworks for AI features, including metrics, experiments, and agent trace analysis.
  • Mentor junior engineers and help shape team culture, processes, and tooling around experimentation and evaluation.

Matching Summary

Match Score: 75

** JetBrains is seeking a Senior Machine Learning Engineer to enhance AI capabilities across their IDEs. The ideal candidate will have extensive experience in machine learning systems, specifically with LLMs, and will work collaboratively with product teams to implement and optimize AI features. **

Skills & Requirements

Must-have

  • design evaluation frameworks
  • diagnose model performance issues
  • experiment with contexts and models
  • build and maintain helper models
  • LLM evaluation methods and frameworks

Nice-to-have

  • agent-based systems
  • multi-step reasoning agents
  • familiarity with Kotlin

Key Requirements

  • 5+ years of experience as an ML Engineer
  • production-grade ML systems experience
  • LLMs and agent architectures experience
  • end-to-end experiment design and execution
  • strong Python programming skills
  • hands-on experience fine-tuning models

Work Rights

Not specified

Tailored Resume

Cover Letter