Databricks is looking for a Staff Software Engineer specializing in Machine Learning to enhance their Search product, focusing on improving search quality and relevance for their vast array of customer assets. The ideal candidate will have a strong background in developing search relevance systems, particularly using large language models (LLMs), and will work with a collaborative team to drive innovative AI solutions
Job Summary
Databricks' customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform.
In 2025, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale.
You’ll have the opportunity to shape the future of AI-driven products at Databricks, work with cutting-edge models, and collaborate with a world-class team of AI and ML experts.
Matching Summary
Match Score: 85
Databricks is looking for a Staff Software Engineer specializing in Machine Learning to enhance their Search product, focusing on improving search quality and relevance for their vast array of customer assets. The ideal candidate will have a strong background in developing search relevance systems, particularly using large language models (LLMs), and will work with a collaborative team to drive innovative AI solutions.
Skills & Requirements
Must-have
ML based search and discovery relevance models
NLP pipelines for query understanding
Automated ML pipelines for data preprocessing
Framework for evaluating search ranking improvements
Nice-to-have
Novel business strategies and product roadmaps
Cutting-edge models and AI/ML experts
Key Requirements
10+ years experience developing search relevance systems