Senior Software Engineer, AI Model Serving

About the Role

Join our fully distributed team as a Senior Software Engineer, AI Model Serving, to build and optimize the infrastructure that brings cutting-edge AI models to millions of users globally. This pivotal role is perfect for a strategic thinker passionate about product decisions and delivering exceptional user experiences.

Responsibilities

• Design, develop, and maintain scalable and reliable AI model serving infrastructure.
• Optimize model inference performance, latency, and throughput for production systems.
• Collaborate closely with AI research scientists to deploy and integrate new models.
• Implement robust monitoring, logging, and alerting for AI services.
• Contribute to shaping product decisions and ensuring delightful user experiences.

Requirements

• Proven experience as a Senior Software Engineer, ideally with a focus on AI/ML infrastructure or distributed systems.
• Strong proficiency in programming languages such as Python, Go, or Java.
• Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure) and containerization (e.g., Docker, Kubernetes).
• Solid understanding of machine learning deployment pipelines and MLOps principles.
• Ability to think strategically, thrive in fast-paced environments, and make impactful product decisions.
• Experience in building user-facing systems or APIs.

Work Arrangement

• This is a 100% distributed role, allowing you to work from anywhere internationally (outside the USA).
• Collaborate with a diverse and talented global team.