Staff Software Engineer, Inference

Lead technical initiatives for CoreWeave's AI inference platform.

• •As a Staff Software Engineer on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple services and teams.
• •You will work deeply in distributed systems and Kubernetes-based infrastructure.
• •Key Responsibilities Lead cross-team design initiatives.
• •Optimize inference performance (latency, throughput, and GPU utilization).
• •Improve system reliability at scale.
• •Work deeply in distributed systems and Kubernetes-based infrastructure.
• •Focus on areas like scheduling, batching, and memory optimization.
• •Requirements 8–12+ years of experience building and operating large-scale distributed systems or cloud platforms.
• •Proven experience leading cross-team technical initiatives.
• •Strong programming skills in Go, Python, or C++.