Systems Generalist, GPT Infrastructure

Builds an automated inference optimization platform for AI models.

• •Seeking an experienced systems generalist to build an automated inference optimization platform.
• •This role involves designing and implementing both control plane and partner-side software for evaluating AI model candidates on real hardware.
• •Key Responsibilities Design and operate control-plane services for optimization campaigns.
• •Build secure partner-side software for evaluating candidates on hardware.
• •Integrate hardware profiles, compilers, and runtimes into an optimization workflow.
• •Develop correctness and performance evaluation systems.
• •Build artifact and qualification workflows for safe deployment.
• •Requirements 8+ years of professional software engineering experience in distributed systems, infrastructure, or cloud services.
• •Strong programming skills in C++, Python, Go, or Rust.
• •Experience designing and operating highly available backend systems, APIs, or job orchestration systems.