Senior Staff Production Engineer - Streaming Platform (Remote, Americas)
Senior Staff Production Engineer - Streaming Platform (Remote, Americas)
About the role
At Shopify, Senior Staff Production Engineers use their expertise and passion to multiply the overall output of their group. As a technical leader, you will help drive your group’s vision and execution. You and the team will empower all teams at Shopify to build stream processing applications. Merchants that depend on Shopify for a highly scalable, performant, and reliable platform benefit directly from the work you do. You will maintain a high bar for quality and lead and mentor other engineers. And of course, you will be hands-on in the code and contribute technically.
As a senior technical leader of the Streaming Platform, you will
take on a leadership role to build a stream processing infrastructure used by teams across Shopify
work closely with the four streaming platform teams comprised of 30+ developers
drive the vision for and build a streaming platform that is operationally mature, extensible, and easy to use by teams across the company
Qualifications
Experience and skills that are important for success in these role:
A proven track record of success in leading large software development teams — strong technical mentorship and vision are a must
Deep experience with streaming technologies (Apache Kafka/Pulsar, Change Data Capture)
Deep experience with the internals of distributed stream processing engines (Apache Flink / Dataflow / Apache Spark / Apache Samza)
Track record of productionizing stream processing projects
End-to-end experience with streaming technologies in building and operating near real-time applications
Experience building and leading the technical vision of stream processing platforms
Experience with cloud infrastructure (Google Cloud Platform, Kubernetes, Terraform)
Exceptional communication skills
Preferred qualifications:
Committer in the Apache Flink or other streaming related open-source software projects
Experience with streaming OLAP systems (Apache Pinot, Apache Druid, Clickhouse)
Experience with modern big data storage technologies (Apache Iceberg, Apache Hudi, Delta Lake)
We offer you:
An opportunity to have massive impact. Joining us in the beginning of our journey, you will help us evolve the streaming platform to enable stream processing applications processing millions of events per second with strict uptime and latency needs. You will help us make stream processing easy and operationally mature at Shopify.
A group of exceptionally talented and dedicated peers with which to collaborate. You will be one of the two senior technical leads for our group of 30+ engineers.
A constant stream of new things to learn. We're always expanding into new areas, bringing in open source projects, contributing back, and exploring new technologies.
Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look at our Sustainability Reports to learn more about Shopify’s commitments to our communities, and our planet.
At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.