Staff Software Engineer, AI Gateway

About the Role

Join Docker's innovative team as a Staff Software Engineer, AI Gateway, to build the backbone of the future of agent-based development. This role offers a unique opportunity to design and implement core systems for the Docker AI Gateway, a powerful, intelligent, and secure control point that simplifies AI agent deployment from prototype to production by eliminating the toil of model orchestration, tool management, observability, and governance.

Responsibilities

• Design, implement, and maintain highly scalable and secure core systems for the Docker AI Gateway, focusing on model and tool routing, security, cost optimization, and unified observability.
• Drive architectural decisions and contribute to the technical roadmap for AI infrastructure, ensuring the Gateway's reliability, performance, and operational excellence.
• Collaborate with cross-functional teams to integrate new features, improve existing services, and ensure a familiar OpenAI-compatible interface.
• Mentor junior engineers, foster a culture of technical excellence, and contribute to best practices in a remote-first environment.

Requirements

• Extensive experience (8+ years) in software engineering, with a strong focus on designing and building distributed systems and cloud-native architectures.
• Proficiency in one or more backend programming languages (e.g., Go, Python, Java) and experience with robust API and service development.
• Proven experience with AI/ML infrastructure, API gateways, orchestration systems, or related complex backend services.
• Strong system design, problem-solving, and communication skills, with the ability to lead technical initiatives.

Work Arrangement

• This is a full-time, remote position, open to candidates located in the United States.