Engineering Manager, API Core
AnthropicGenerative AI, company
San Francisco, United StatesManager
Software Engineering
About the role
Lead API Core engineering to scale and reliability of the Claude API hot path.
- •Lead the API Core team owning the /v1/messages hot path, improving efficiency, throughput, and reliability of Anthropic's Claude API and translating compute capacity into customer-facing throughput.
- •Key Responsibilities Manage hiring, performance, and career development for the API Core team.
- •Set technical strategy and deliver roadmap for service efficiency, throughput scaling, and rate-limiting systems.
- •Drive multi-quarter initiatives to reduce per-request overhead and optimize request pipelines.
- •Partner with Inference and Compute on capacity planning and operational responses to constrained periods.
- •Define reliability standards, SLOs, error-budget management, and incident reviews.
- •Requirements 10+ years managing engineering teams, ideally for high-throughput, latency-sensitive services.
- •Proven track record delivering service-efficiency or throughput improvements at scale.
- •Depth in systems performance, distributed systems, or API platform design (e.g., Rust, Go, load balancing, rate limiting).
- •Experience making architectural decisions under capacity pressure and cross-functional leadership.
Tech stack
Anthropic APIREST APIgRPCGoRustLinux
Match insights
Tech:Anthropic API, REST API, gRPC, Go, Rust
Level:Manager
Location:San Francisco, United States