Staff Software Engineer- Search Quality

Databricks Lakehouse

Bengaluru, India
On-site
Hybrid retrieval (keyword and semantic)
Dual-optimization ranking models
High-stakes accuracy for ai
Databricks is seeking a Staff Software Engineer specializing in Search Quality to enhance data retrieval systems for both AI agents and human users. The role involves optimizing search quality and accuracy, leveraging expertise in information retrieval technologies

Job Summary

  • We are building the retrieval backbone for two worlds: the high-precision context layer for AI agents and the intuitive search experience for people.
  • You will own the quality of results for two distinct but deeply connected "users": The AI Agent and The Human User.
  • You will have a front-row seat to the Agentic revolution and solve the hardest problems in data discovery.

Matching Summary

Match Score: 85

Databricks is seeking a Staff Software Engineer specializing in Search Quality to enhance data retrieval systems for both AI agents and human users. The role involves optimizing search quality and accuracy, leveraging expertise in information retrieval technologies.

Skills & Requirements

Must-have

  • Hybrid Retrieval (keyword and semantic)
  • Dual-optimization ranking models
  • High-stakes accuracy for AI
  • Data heterogeneity across sources
  • Lucene/Elasticsearch expertise
  • Embeddings and ranking algorithms
  • Relevance metrics (nDCG, MRR, Precision@K)

Nice-to-have

  • Building evaluation frameworks
  • LLM-based evaluation
  • Human-in-the-loop evaluation

Key Requirements

  • IR Specialist
  • Quality and Metrics Obsessive
  • Bridge Builder (IR to RAG)

Work Rights

Not specified

Tailored Resume

Cover Letter