Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Engineer cloud inference systems for AI model launches and performance optimization.

• •The Cloud Inference team scales and optimizes Claude for massive audiences across AWS, GCP, and Azure.
• •This role focuses on the validation pipeline for inference servers and load balancers, ensuring correctness, performance, and reliability for all inference changes.
• •Key Responsibilities Be on the critical path for frontier model launches, bringing up inference for new model architectures and shipping them to cloud platforms.
• •Design, build, and own the CI/CD infrastructure for the inference server and load balancer across cloud platforms.
• •Drive down merge-to-production cycle time by making validation faster, more parallel, and cost-effective.
• •Analyze observability data across providers to identify performance bottlenecks and drive remediation.
• •Requirements Significant software engineering experience with a strong background in high-performance, large-scale distributed systems.
• •Track record of building automation or test infrastructure that improved release velocity or reliability.
• •Experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure).
• •Thrive in cross-functional collaboration and are highly autonomous.