Software Engineer, Cortex AI Infrastructure
SnowflakeCloud Data company
Menlo Park, United StatesMid
Software Engineering
About the role
Build scalable backend infrastructure powering agentic AI runtimes and RAG systems.
- •Join Snowflake's Cortex Apps team to build backend infrastructure powering agentic AI products like Snowflake Intelligence, Cortex Agents, and Search.
- •The role focuses on scalable, low-latency orchestration, RAG infrastructure, and evaluation/experiment engines for enterprise AI.
- •Key Responsibilities Build and scale agentic runtimes and orchestration engines for agent workflows.
- •Design high-performance RAG systems: vector indices, search indexing, and semantic caching.
- •Develop large-scale evals engine for simulations and error analysis.
- •Productionize multi-tenant AI microservices with observability and guardrails.
- •Optimize performance: model routing, prompt caching, and token efficiency.
- •Requirements Bachelor's in CS or related (Masters/PhD preferred). 4+ years building distributed systems, high-throughput APIs, or data-intensive platforms.
- •Deep proficiency in Python; strong experience with Go or Java; familiarity with C++.
- •Understanding of database internals, distributed state management, and cloud-native (Kubernetes, FoundationDB).
Tech stack
PythonGoJavaC++KubernetesPyTorchTensorFlowRedisElasticsearchSnowflakeCI/CD
Match insights
Tech:Python, Go, Java, C++, Kubernetes
Level:Mid
Location:Menlo Park, United States