Job Description:
Role Overview:
We are seeking an experienced Director Data Engineering to lead and scale a high-performing data engineering organization. This leadership role will be responsible for driving the strategy, architecture, delivery, governance, and operational excellence of enterprise data platforms built on Azure and Databricks.
The ideal candidate will have strong experience leading large engineering teams, managing engineering managers, and delivering scalable data platforms that support analytics, AI/ML, and business intelligence initiatives.
Key Responsibilities:
Data Platform Strategy & Architecture:
- Define and execute the enterprise data engineering roadmap.
- Drive the evolution of modern data platforms built on Azure and Databricks.
- Establish scalable data architecture, ingestion frameworks, transformation patterns, and data consumption standards.
- Balance platform innovation, scalability, performance, and cost optimization.
Engineering Leadership & Delivery:
- Lead a data engineering organization of 40+ engineers.
- Drive end-to-end delivery of multiple data engineering programs and initiatives.
- Ensure platform reliability, operational excellence, and adherence to SLAs.
- Oversee capacity planning, resource allocation, and execution management.
Data Governance & Quality:
- Establish enterprise-wide data governance practices.
- Implement data quality frameworks, monitoring, lineage, and observability.
- Ensure secure data handling, compliance, and access controls.
- Drive best practices around data reliability and platform operations.
People Leadership:
- Lead, mentor, and develop Engineering Managers, Tech Leads, and senior engineers.
- Drive hiring, onboarding, performance management, and succession planning.
- Build a culture of ownership, accountability, innovation, and engineering excellence.
Stakeholder Management:
- Partner with Product, Analytics, AI/ML, and Platform teams.
- Align engineering priorities with business objectives.
- Communicate delivery progress, risks, and strategic initiatives to executive leadership.
Required Skills:
- 15+ years of experience in Data Engineering or Data Platform Engineering.
- 6+ years leading large engineering organizations (30+ engineers).
- Experience managing Engineering Managers and senior technical leaders.
- Deep expertise in:
1. Azure Cloud
2. Databricks
3. Data Lakes / Lakehouse Architectures
4. Enterprise Data Platforms
- Strong understanding of:
1. Data Governance
2. Data Quality
3. Data Security
4. Data Reliability Engineering
- Experience designing large-scale, distributed data systems.
- Strong architectural and strategic leadership capabilities.
Preferred Skills:
- Experience supporting Analytics, BI, and AI/ML workloads.
- Exposure to healthcare, financial services, or enterprise-scale data environments.
- Knowledge of modern data engineering frameworks and cloud-native architectures.
- Experience with platform modernization Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field.
(ref:iimjobs.com)