Research Engineer (agentic Behavior – Kotlin Ai Value Stream)

Jetbrains

Amsterdam, Netherlands
**
Build evaluation pipelines
Research methods for improving agent behavior
Python engineering skills
** JetBrains is seeking a Research Engineer to join their Kotlin AI Value Stream team, focused on enhancing AI coding agents for Kotlin. The role involves building evaluation pipelines, analyzing agent performance, and researching improvements to agent behavior, all while contributing to the development of tools and benchmarks that support Kotlin developers. **

Job Summary

  • The Kotlin AI Value Stream team is responsible for how AI agents understand, generate, and improve Kotlin code across all platforms.
  • As a Research Engineer on this team, you'll own the end-to-end loop: Analyze how agents fail on Kotlin → build evals that capture those failures → research and implement methods to fix them → measure the improvement.
  • We offer competitive pay that reflects your skills and experience, flexible work location, remote work, extra time off, and more.

Matching Summary

Match Score: 75

** JetBrains is seeking a Research Engineer to join their Kotlin AI Value Stream team, focused on enhancing AI coding agents for Kotlin. The role involves building evaluation pipelines, analyzing agent performance, and researching improvements to agent behavior, all while contributing to the development of tools and benchmarks that support Kotlin developers. **

Skills & Requirements

Must-have

  • build evaluation pipelines
  • research methods for improving agent behavior
  • Python engineering skills
  • data analysis at scale
  • product-aware mindset

Nice-to-have

  • post-training LLMs experience
  • modern deep learning frameworks
  • AI agent development experience
  • evaluation frameworks and tools
  • experiment tracking and observability

Key Requirements

  • Hands-on experience building evaluation or analysis pipelines for LLMs or AI coding agents
  • Strong Python engineering skills (at least three years)
  • Experience with data analysis at scale
  • Ability to own projects end to end
  • Familiarity with Kotlin or strong willingness to develop deep Kotlin expertise

Work Rights

Not specified

Tailored Resume

Cover Letter