Senior Streaming Engineer, Data Integrations

About the Role

Join our team as a Senior Streaming Engineer, Data Integrations, in a fully remote capacity across the USA, Canada, or Mexico. This pivotal role offers the opportunity to design, build, and optimize high-performance data streaming pipelines, ensuring seamless and reliable data flow for critical business operations and analytics.

Responsibilities

• Architect, develop, and maintain robust real-time data streaming solutions using industry-leading technologies (e.g., Apache Kafka, Flink, Spark Streaming).
• Implement and manage complex data integration processes from diverse source systems to various data consumers.
• Monitor, troubleshoot, and optimize data pipelines to ensure high availability, performance, and data quality.
• Collaborate closely with data architects, data scientists, and other engineering teams to define requirements and deliver scalable data solutions.
• Drive best practices in data governance, security, and compliance for streaming data.

Requirements

• 5+ years of experience in data engineering with a strong focus on real-time data streaming and integration.
• Deep expertise with streaming platforms such as Apache Kafka, Apache Flink, or Spark Streaming.
• Proficient in programming languages like Java, Scala, or Python for data pipeline development.
• Solid understanding of distributed systems, cloud environments (AWS, Azure, or GCP), and microservices architecture.
• Experience with various data storage technologies (e.g., relational databases, NoSQL, data lakes).
• Strong analytical and problem-solving skills, with a commitment to delivering high-quality, scalable solutions.

Nice-to-Haves

• Familiarity with schema registries (e.g., Confluent Schema Registry) and data serialization formats (e.g., Avro, Protobuf).
• Experience with containerization (Docker, Kubernetes) and CI/CD pipelines for data applications.
• Knowledge of data governance frameworks and data observability tools.
• Prior experience in a remote work environment.