Senior Data Engineering Lead - Azure PlatformWorkassist • Gurgaon

Senior Data Engineering Lead - Azure Platform

Workassist • Gurgaon

30+ days ago

Job description

Description :

Position : Senior Data Engineering Team Leader (Azure Focus)

Work Level : Senior Leadership

Industry Type : IT Services & Consulting

Job Summary :

We are seeking a Disciplined and innovation-focused Senior Data Engineering Team Leader to lead a team in designing and implementing advanced data solutions on the Microsoft Azure cloud platform. This leadership role requires a minimum of three years of hands-on Azure Data Engineering experience, coupled with deep proficiency in Databricks, PySpark, and complex SQL. The leader will be responsible for driving technical innovation, mentoring a team of 5+ members, and delivering high-performance, scalable data pipelines for our IT Services and Consulting clients.

Job Description :

Technical Leadership and Innovation :

Provide Senior Leadership and technical oversight for a team of 5 or more Data Engineers, fostering a culture of technical excellence, accountability, and continuous improvement.
Drive Innovation within the data engineering function by evaluating and integrating cutting-edge Azure services, advanced Databricks features, and modern data processing methodologies to improve pipeline efficiency and capability.
Lead the technical design sessions and architectural reviews, ensuring all data solutions are scalable, resilient, and adhere to enterprise-level security and governance standards on Azure.
Instill Disciplined engineering practices, including robust code review processes, documentation standards, and continuous adherence to CI / CD pipelines for all data assets.

Azure Data Platform Engineering :

Possess 3+ years of mandatory, hands-on experience leading and delivering complex data engineering development projects within the Microsoft Azure cloud ecosystem.

Design and implement high-volume, low-latency ETL / ELT data pipelines using core Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure Key Vault.

Demonstrate 2+ years of deep, proven proficiency in developing, optimizing, and deploying complex data processing jobs utilizing Databricks notebooks and clusters.

Master the use of PySpark (Python with Spark) to perform advanced data transformations, aggregations, and feature engineering at scale within the Databricks environment.

Data Modeling and Team Management :

Develop and optimize complex SQL queries, stored procedures, and data models for consumption by reporting tools and analytical applications, managing data integration with services like Azure SQL Database or Synapse Analytics.

Provide expert-level guidance on performance tuning for Spark jobs, Databricks clusters, and SQL execution plans to ensure optimal query response times and resource utilization.

Demonstrate 2+ years of mandatory experience effectively leading and managing the day-to-day work, career development, and technical delivery of a data engineering team of 5 or more members.

Act as the primary technical point of contact, leveraging strong communication skills to articulate complex technical issues and architectural decisions to clients, product owners, and senior stakeholders.

Required Skills & Qualifications :

Experience : Mandatory 5+ years total experience in data engineering, including 3+ years of dedicated experience in Azure development projects.

Leadership : Mandatory 2+ years experience successfully leading and mentoring a data engineering team of 5 or more members.

Cloud & Platform : Deep technical expertise in the Microsoft Azure data ecosystem.

Big Data Tools : Mandatory proficiency (2+ years) with Databricks, PySpark for scalable data processing, and expert-level SQL for data manipulation and modeling.

Core Skills : Exceptional technical communication, stakeholder management, and problem-solving abilities within a consulting environment.

Education : Mandatory Graduate degree.

Preferred Skills :

Advanced Azure Services : Hands-on experience with Azure Synapse Analytics (SQL Pool, Spark Pool) for integrated data warehousing and big data workloads.

Data Visualization : Experience integrating data pipelines with leading business intelligence tools such as Tableau and Power BI for final data consumption.

Programming Languages : Proficiency in Scala or Java in addition to Python for high-performance data processing tasks.

DevOps for Data : Experience with specific CI / CD tools (e.g., Azure DevOps, GitHub Actions) for automating Databricks and Azure Data Factory deployments.

Data Governance : Familiarity with Azure Purview or other data governance tools for metadata management and data lineage tracking.

(ref : hirist.tech)

Create a job alert for this search

Data Engineering Lead • Gurgaon

Related jobs

Senior Data Engineer

dunnhumby • Gurugram, Haryana, India

Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a p...Show more

Last updated: 2 days ago • Promoted

Xebia - Senior Azure Data Engineer

Xebia IT Architects India Pvt Ltd • Gurugram

Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

People Connect Consultants • Gurgaon

Description : - At GKM IT, were passionate about building seamless digital experiences powered by robust and intelligent data systems.Were on the ...Show more

Last updated: 15 days ago • Promoted

Senior Data Engineer

Zyoin Group • Gurugram

Description : We are seeking a Senior Data Engineer with 4+ years of experience in building scalable, distributed, and h...Show more

Last updated: 30+ days ago • Promoted

Azure Data Architect

DHI Solutions • Gurugram

Description : Role Overview : Seeking a highly skilled Azure Data Architect with deep expertise in Databric...Show more

Last updated: 17 days ago • Promoted

Azure Data Engineering Lead - ETL / PySpark

Techno Wise • Gurgaon

Location : Gurugram (Work from Office 5 Days) Notice Period : Immediate to 45 Days About the Role : We are looking...Show more

Last updated: 30+ days ago • Promoted

Publicis Sapient - Senior Manager - Data Engineering

Publicis Sapient • Gurgaon

Job Description : We are looking for a technically strong, business friendly Data Engineering Leader who can drive initiatives across data lake infrastructure, large-...Show more

Last updated: 22 days ago • Promoted

SyanSoft - Senior Consultant - Data Engineering

SyanSoft Technologies • Gurugram

Experience : - 6+ years of experience in data engineering, manipulation, and analytics support roles across various doma...Show more

Last updated: 30+ days ago • Promoted

Senior Snowflake Data Engineer

Luxoft • Gurgaon, Haryana, India

Project Description : We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AW...Show more

Last updated: 2 days ago • Promoted

Auxo AI - Senior Data Engineer - Google Cloud Platform

AuxoAI • Gurgaon

Description : AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data ...Show more

Last updated: 9 days ago • Promoted

Publicis Sapient - Data Engineering Manager / Architect

Publicis Sapient • Gurgaon

Manager Data Engineer As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing GCP / Azure ...Show more

Last updated: 30+ days ago • Promoted

Senior Lead Engineer - Data [T500-20748]

REA Cyber City • Gurugram, Haryana, India

In 1995 in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?” Could we? Yes. Fast forward 30 years, REA Group is a ma...Show more

Last updated: 5 days ago • Promoted

ProcDNA - Data Engineering Lead - ETL Tools

PROCDNA ANALYTICS PRIVATE LIMITED • Gurugram

Description : ProcDNA is a global consulting firm.We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology sol...Show more

Last updated: 30+ days ago • Promoted

Senior / Lead Data Engineer

DoublU • Gurugram

Key Responsibilities & Technical Deliverables : 1.Data Pipeline Engineering Pipeline Development : Architect, build, and optimize complex data pi...Show more

Last updated: 28 days ago • Promoted

Senior Data Engineer

S&P Global • Gurgaon, Haryana, India

This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.About the Rol...Show more

Last updated: 28 days ago • Promoted

Senior Data Engineering Lead - Azure Platform

Workassist • Gurugram

Description : Position : Senior Data Engineering Team Leader (Azure Focus) Work Level : Senior Leadership Industry Type : I...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITED • Gurugram, Haryana, India

ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more

Last updated: 5 days ago • Promoted

Data Engineering Lead - Python / SQL

People Connect Consultants • Gurgaon

Description : Were looking for a Data Engineer - Lead to shape and scale our data engineering function.In this role, you will lead a high-performing team, define tec...Show more

Last updated: 22 days ago • Promoted