Senior Manager - Data Engineering

Purpose & Scope:

The Senior Data Engineering Manager is responsible for leading the delivery and operational excellence of enterprise data engineering capabilities that underpin Data Products, analytics, and AI enablement.

This role manages a team of data engineers and partners closely with Data Product Managers, Platform teams, Governance, and Analytics to deliver reliable, scalable, secure, and wellgoverned data pipelines and curated datasets aligned to business priorities.

The Senior Data Engineering Manager focuses on execution, engineering rigor, team leadership, and crossfunctional coordination, while product strategy and prioritization remain with Product leadership.

What you will be doing (responsibilities):

1. Data Engineering Delivery

• Lead endtoend delivery of data pipelines and curated datasets supporting enterprise data products.
• Drive predictable execution aligned to sprint and release plans in partnership with Product and Delivery leadership.
• Establish and enforce engineering standards for pipeline design, data transformations, testing, and reusability.
• Proactively manage delivery risks, technical dependencies, and production issues.

2. Platform & Architecture Alignment

• Ensure engineering solutions align with enterprise data platform standards and lakehouse design patterns.
• Partner with platform and architecture teams to implement scalable, secure, and costeffective engineering solutions.
• Guide teams on appropriate use of shared platforms, environments, and datasets.

3. Data Quality, Governance & Trust

• Embed automated data quality checks and monitoring into pipelines as standard practice.
• Ensure metadata, lineage, and documentation requirements are met to support discoverability and governance.
• Partner with data governance and security teams to ensure compliance, auditability, and responsible data usage.

4. Engineering Excellence & Operational Readiness

• Drive CI/CD practices for data pipelines, including automated testing, deployments, and controlled promotions.
• Ensure pipelines are operationally ready with monitoring, alerting, and clear ownership for incident resolution.
• Continuously improve performance, reliability, and cost efficiency of data workloads.

5. Stakeholder & CrossFunctional Collaboration

• Partner with Data Product Managers to translate product needs into executable engineering deliverables.
• Collaborate with Analytics and BI teams to ensure data assets support governed reporting and consumption.
• Communicate delivery status, risks, and tradeoffs clearly to stakeholders and leadership.

6. People Leadership & Team Development

• Manage, mentor, and develop a team of data engineers across experience levels.
• Set clear expectations around quality, delivery discipline, and operational ownership.
• Foster a culture of continuous improvement, documentation, and shared accountability.

What you bring (Qualifications):

MustHave (Strong handson leadership):

• Databricks & Apache Spark – delivery leadership, troubleshooting, performance tuning
• Azure – operating within Azurebased data ecosystems, identity and access concepts
• Delta Lake / Lakehouse patterns – scalable data modeling and pipeline design
• CI/CD for data pipelines – automated build, test, deploy, and release practices
• SQL & Python – strong proficiency

GoodtoHave:

• SODA or equivalent data quality / observability tools
• Atlan or similar data catalog and metadata platforms
• Power BI awareness – understanding downstream reporting and consumption requirements

Qualifications:

• Typically 12+ years of experience in data engineering, including team or delivery leadership roles.
• Experience building and operating enterprisescale data pipelines in complex environments.
• Strong stakeholder management skills across product, engineering, analytics, and governance teams.
• Ability to balance speed, quality, and stability in delivery decisions.