This job offer is not available in your country.
Senior Data Engineering Lead - Azure Platform
WorkassistGurgaon7 days ago
Job descriptionPossess 3+ years of mandatory, hands-on experience leading and delivering complex data engineering development projects within the Microsoft Azure cloud ecosystem. Design and implement high-volume, low-latency ETL / ELT data pipelines using core Azure services, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure Key Vault. Demonstrate 2+ years of deep, proven proficiency in developing, optimizing, and deploying complex data processing jobs utilizing Databricks notebooks and clusters. Master the use of PySpark (Python with Spark) to perform advanced data transformations, aggregations, and feature engineering at scale within the Databricks environment. Develop and optimize complex SQL queries, stored procedures, and data models for consumption by reporting tools and analytical applications, managing data integration with services like Azure SQL Database or Synapse Analytics. Provide expert-level guidance on performance tuning for Spark jobs, Databricks clusters, and SQL execution plans to ensure optimal query response times and resource utilization. Demonstrate 2+ years of mandatory experience effectively leading and managing the day-to-day work, career development, and technical delivery of a data engineering team of 5 or more members. Act as the primary technical point of contact, leveraging strong communication skills to articulate complex technical issues and architectural decisions to clients, product owners, and senior stakeholders. Experience : Mandatory 5+ years total experience in data engineering, including 3+ years of dedicated experience in Azure development projects. Leadership : Mandatory 2+ years experience successfully leading and mentoring a data engineering team of 5 or more members. Cloud & Platform : Deep technical expertise in the Microsoft Azure data ecosystem. Big Data Tools : Mandatory proficiency (2+ years) with Databricks, PySpark for scalable data processing, and expert-level SQL for data manipulation and modeling. Core Skills : Exceptional technical communication, stakeholder management, and problem-solving abilities within a consulting environment. Education : Mandatory Graduate degree. Advanced Azure Services : Hands-on experience with Azure Synapse Analytics (SQL Pool, Spark Pool) for integrated data warehousing and big data workloads. Data Visualization : Experience integrating data pipelines with leading business intelligence tools such as Tableau and Power BI for final data consumption. Programming Languages : Proficiency in Scala or Java in addition to Python for high-performance data processing tasks. DevOps for Data : Experience with specific CI / CD tools (e.g., Azure DevOps, GitHub Actions) for automating Databricks and Azure Data Factory deployments. Data Governance : Familiarity with Azure Purview or other data governance tools for metadata management and data lineage tracking.
Description :
Position : Senior Data Engineering Team Leader (Azure Focus)
Work Level : Senior Leadership
Industry Type : IT Services & Consulting
Job Summary :
We are seeking a Disciplined and innovation-focused Senior Data Engineering Team Leader to lead a team in designing and implementing advanced data solutions on the Microsoft Azure cloud platform. This leadership role requires a minimum of three years of hands-on Azure Data Engineering experience, coupled with deep proficiency in Databricks, PySpark, and complex SQL. The leader will be responsible for driving technical innovation, mentoring a team of 5+ members, and delivering high-performance, scalable data pipelines for our IT Services and Consulting clients.
Job Description :
Technical Leadership and Innovation :
- Provide Senior Leadership and technical oversight for a team of 5 or more Data Engineers, fostering a culture of technical excellence, accountability, and continuous improvement.
- Drive Innovation within the data engineering function by evaluating and integrating cutting-edge Azure services, advanced Databricks features, and modern data processing methodologies to improve pipeline efficiency and capability.
- Lead the technical design sessions and architectural reviews, ensuring all data solutions are scalable, resilient, and adhere to enterprise-level security and governance standards on Azure.
- Instill Disciplined engineering practices, including robust code review processes, documentation standards, and continuous adherence to CI / CD pipelines for all data assets.
Azure Data Platform Engineering :
Data Modeling and Team Management :
Required Skills & Qualifications :
Preferred Skills :
(ref : hirist.tech)
Create a job alert for this search
Data Engineering Lead • Gurgaon
Related jobs
- Promoted
Azure AD & MS SQL Server Administrator
Yamaha Motor Solutions IndiaFaridabad, Haryana, India Set up & Maintain Azure Hybrid Cloud Core Infrastructure.Install, maintain & upgrade MS SQL Server Database on Azure Cloud in a Secure, HA & DR Environment.
Active Directory (AD), ADFS Administratio...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsDelhi, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 22 days ago
- Promoted
Lead Data Engineer
Searce IncDelhi, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 9 days ago
- Promoted
iScala / Epicor Functional Consultant
Next VenturesDelhi, IN Next Ventures is seeking am iScala / Epicor Functional SME for a freelance role with our client in Europe.We are seeking an experienced iScala Epicor Functional SME to support a major global IT car...Show moreLast updated: 22 days ago
- Promoted
Senior Lead Data Engineer
TerraFinn TechnologiesDelhi, IN TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally.
The company focuses on providing expert employees to he...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
HealthyMe AIDelhi, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
The Mastermind GroupDelhi, IN Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG).
Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
- Promoted
Backend and Data Pipeline Engineer
JRD SystemsGhaziabad, IN Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer
SAIVA AIDelhi, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 22 days ago
- Promoted
Founding Sr. Machine Learning Engineer : No Salary Only Equity
Truxt.aiDelhi, IN As an early-stage company driven by a meaningful mission, we seek exceptional engineering talent who values purpose, long-term impact, and significant equity ownership over traditional salary compe...Show moreLast updated: 30+ days ago
- Promoted
Data Platform Engineer
Intuitive.CloudDelhi, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 20 days ago
- Promoted
GCP Data Engineer
TEKsystemsDelhi, IN We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant).
Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 22 days ago
- Promoted
Salesforce Data Cloud Architect
RialtesDelhi, IN Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of.
Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Azure databricks
EXLGhaziabad, IN Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: 14 days ago
- Promoted
Cloud Database Administrator
ZarthiDelhi, IN Job Description : Cloud Database Administrator (DBA).Zarthi is a technology service provider that acts as a catalyst for businesses.
We have established relationships with companies and organizations...Show moreLast updated: 29 days ago
- Promoted
Senior Full Stack SDE with Data Engineering for Analytics
TruckmentumDelhi, IN Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
- Promoted
Azure Architect (Data Engineering)
Polestar AnalyticsNoida, Uttar Pradesh, India Job Title : Azure Architect – Analytics & Data Services.Location : Noida / Kolkata / Bengaluru.Lead end-to-end architecture design for data and analytics solutions on Azure.
Define and implement Azure-bas...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineer Lead
Creative Synergies GroupDelhi, India Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 5 days ago
- Promoted
Azure Data Architect
Programmers.ioDelhi, India Job Title : Azure Data Architect.Location : Hyderabad, pune (hybrid).Experience required : 12+ years.We are seeking a highly experienced Senior Azure data architect to design and implement robust, sca...Show moreLast updated: 5 days ago
- Promoted
Senior Big Data Engineer
VeltrisDelhi, IN Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 29 days ago