Senior Staff Applied AI Engineer - Context Retrieval
DatabricksData Lakehouse company
Mountain View, United StatesSenior
Data & AI
About the role
Builds retrieval stack and search subagents for Databricks agents to improve context retrieval.
- •P-1549 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems
- •from making the next mode of transportation a reality to accelerating the development of medical breakthroughs.
- •We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
- •The Mission Databricks agents are only as good as the context they can retrieve.
- •Whether an agent is answering a question about last quarter's revenue, debugging a failing job, generating SQL against a 10,000-table lakehouse, or summarizing a Wiki page, its quality is bounded by what it can find
- •and how well it understands what it finds.
- •We are hiring a Senior Staff Applied AI Engineer to own context retrieval for Databricks agents across SaaS providers.
- •This is a zero-to-one role with two deeply connected charters: Build the retrieval stack
- •query understanding, content understanding, ranking, retrieval, and evaluation
- •across the Enterprise SaaS data stored across multiple systems.
Tech stack
PythonSQLDatabricksOpenAI APIAnthropic APIGemini APILangChainHugging FaceNLPLLMsElasticsearchAWSGoogle CloudAzureGit
Match insights
Tech:Python, SQL, Databricks, OpenAI API, Anthropic API
Level:Senior
Location:Mountain View, United States