Senior Staff Applied Ai Engineer - Context Retrieval
Databricks
Mountain View, California, US
On-site
10+ years software engineering experience
Deep information retrieval expertise
Production rag system development
This role involves building the foundational retrieval stack and search subagents that determine the quality of all Databricks agents
Job Summary
This role involves building the foundational retrieval stack and search subagents that determine the quality of all Databricks agents.
The engineer will own the end-to-end system including query understanding, hybrid retrieval, ranking, and evaluation across heterogeneous data sources.
Candidates must demonstrate a track record of building zero-to-one retrieval systems from scratch while operating as a technical leader.
Matching Summary
This role involves building the foundational retrieval stack and search subagents that determine the quality of all Databricks agents.
Skills & Requirements
Must-have
10+ years software engineering experience
Deep Information Retrieval expertise
Production RAG system development
Agentic systems design
Structured and unstructured data indexing
Nice-to-have
Enterprise SaaS source experience
Open-source IR project contributions
Embedding model fine-tuning experience
Multi-turn retrieval for LLM agents
Publications at SIGIR or KDD venues
Key Requirements
10+ years of software engineering experience
Significant time building production retrieval or RAG systems
Demonstrated ability to operate as a technical leader