Data Development Manager

Shopify is the leading omni-channel commerce platform. Merchants use Shopify to design, set up, and manage their stores across multiple sales channels, including mobile, web, social media, marketplaces, brick-and-mortar locations, and pop-up shops. The platform also provides merchants with a powerful back-office and a single view of their business, from payments to shipping. The Shopify platform was engineered for reliability and scale, making enterprise-level technology available to businesses of all sizes. Headquartered in Ottawa, Canada, Shopify currently powers over 1,000,000 businesses in approximately 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more.

Our Data Platform Engineering group builds and maintains the platform that delivers accessible data to power decision-making at Shopify for over a million merchants. We’re hiring high-impact developers across teams:

• The Engine group organizes all merchant and Shopify data into our data lake in highly-optimized formats for fast query processing, and maintaining the security and quality of our datasets.

• The Analytics group leverages the Engine primitives to build and deliver simple and useful products that power scalable transformation of data at Shopify in batch, streaming, or for machine learning. This group is focused on making it really simple for our users to answer three questions: What happened in the past? What is happening now? And, what will happen in the future?  

• The Data Experiences group builds end-user experiences for experimentation, data discovery, and business intelligence reporting.

• The Reliability group operates the data platform in a consistent and reliable manner. They build tools for other teams on Data Platform to leverage and encourage consistency as they champion reliability across the platform.

Your role:

• Providing people and technical leadership within your team to support the mission of the Data Platform Engineering group. 

• Working closely with a cross-functional team of product leaders, engineering leaders, and distributed system engineers to influence the organizational vision and help solve hard problems in scaling the data platform.

• Strategic and tactical deliverables for your team.

• Deploying the team towards data platform priorities, achieving measurable impact and outcomes.

• Defining and executing on your team’s deliverables.

• Sourcing and hiring for positions in your team or organization.

• All aspects of performance management, including compensation, performance improvement plans, promotions, and separations.

About You:

• An experienced manager of teams of high-performing engineers.

• Technical engineering background in one or more areas listed in the next section.

• A proven track record of delivering impactful results.

• Exceptional communication skills and ability to translate technical concepts into easy to understand language for our stakeholders. 

• Excitement for working with a remote team; you value collaborating on problems, asking questions, delivering feedback, and supporting others in their goals whether they are in your vicinity or entire cities apart.

A Data Development Manager at Shopify would typically have at least 2 years of experience leading high-functioning teams, and expertise in one or more of the following areas:

• Experience with the internals of a distributed compute engine (Spark, Presto, DBT, or Flink/Beam)

• Experience in query optimization, resource allocation and management, and data lake performance (Presto, SQL)

• Experience with cloud infrastructure (Google Cloud, Kubernetes, Terraform)
  Experience with security products and methods (Apache Ranger, Apache Knox, OAuth, IAM, Kerberos)

• Experience deploying and scaling ML solutions using open-source frameworks (MLFlow, TFX, H2O, etc.)

• Experience building full-stack applications (Ruby/Rails, React, TypeScript)

• Background and practical experience in statistics and/or computational mathematics (Bayesian and Frequentist approaches, NumPy, PyMC3, etc.)

• Modern Big-Data storage technologies (Iceberg, Hudi, Delta)

At Shopify, we are committed to building and fostering an environment where our employees feel included, valued, and heard. Our belief is that a strong commitment to diversity and inclusion enables us to truly make commerce better for everyone. We strongly encourage applications from Indigenous people, racialized people, people with disabilities, people from gender and sexually diverse communities and/or people with intersectional identities.

Please apply before October 15th, 5:00 pm EST. 

Shopify is now permanently remote and working towards a future that is digital by design. Learn more

#LI-REMOTE