Senior Software Engineer, AI Data

About the Role

Join our AI Data team to build robust, scalable systems powering our AI data platform, directly influencing our ability to train and evaluate models at scale.

Responsibilities

• Design scalable, future-proof data platforms optimized for AI research workloads.
• Build efficient self-serve data processing pipelines leveraging GCP's advanced services.
• Implement cost-effective storage and monitoring solutions for ML at scale.
• Create flexible training resource management with intelligent queuing.
• Optimize resource allocation for maximum training efficiency.
• Lead adoption of cutting-edge ML tools and frameworks.
• Streamline existing workflows while introducing new tooling.
• Enhance tooling and documentation to accelerate team velocity.
• Implement guardrails for cost, quality, and performance.
• Identify and eliminate technical bottlenecks in data processing and training pipelines.
• Participate in on-call rotation to ensure system reliability.

Requirements

• 5+ years of professional software engineering experience.
• Strong proficiency in Python and SQL with demonstrated ability to write production-quality code.
• Solid understanding of software engineering fundamentals: data structures, algorithms, system design, testing strategies, and code review practices.
• Experience with RESTful APIs, distributed systems concepts, containerization (Docker), and basic cloud infrastructure.
• Track record of delivering high-quality software in a team environment.
• Ability to thrive in a startup environment with changing priorities and rapid iteration.

Nice-to-Haves

• Experience with GCP services (BigQuery, GCS, Cloud Run, GKE).
• Familiarity with distributed processing frameworks (Apache Beam, PySpark).
• Experience with workflow orchestration tools (Airflow, Prefect, Dagster).
• Understanding of ML/AI infrastructure and data pipelines.
• Experience with monitoring and observability tools (Datadog).
• Experience working directly with researchers.
• Background in data engineering roles.