No longer accepting applications

▷ Apply in 3 Minutes : Lead Data Engineer

People Prime WorldwideIndia

9 hours ago

Job description

About the Company

Our client is a global digital transformation leader with a presence in over 50 countries. Specializing in Oracle Cloud, automation, data intelligence, and enterprise consulting, they help businesses modernize their systems and accelerate innovation at scale.

Job Description

Job Title : Lead Engineer

Experience : 10+ Years

Location : Hyderabad

Job Type : [Full-time ]

Job Summary :

We’re looking for a Lead Data Engineer with deep expertise in the Microsoft Azure data ecosystem to architect, build, and optimize scalable data platforms. This role is ideal for a seasoned professional who thrives on designing modern data architectures and leading high-performing teams to deliver business-driven analytics and AI solutions.

Key Responsibilities

1. Data Architecture & Solution Design

Architect end-to-end data solutions using Azure Data Factory, Databricks, Synapse Analytics, and ADLS Gen2.
Design and implement modern Data Lakehouse and Medallion (Bronze–Silver–Gold) architectures.
Define data ingestion, transformation, and storage standards for all data types.
Align solutions with enterprise data strategy, governance, and security frameworks.
Lead proof-of-concepts and architecture reviews for new initiatives.

2. Data Pipeline Development & Optimization

Build and maintain robust, scalable ETL / ELT pipelines using ADF and Databricks (PySpark).

Implement real-time and batch data ingestion with Azure Event Hubs, Kafka, or Stream Analytics.

Optimize data transformations, partitioning, indexing, and query performance.

Automate workflows using CI / CD and Infrastructure-as-Code (IaC) practices.

3. Data Governance & Quality Management

Establish and enforce governance standards : lineage, metadata, and stewardship.

Implement data quality checks at ingestion and transformation stages.

Utilize Azure Purview or Microsoft Fabric for data cataloging and compliance.

Ensure data security and regulatory compliance (GDPR, HIPAA, etc.).

4. Technical Leadership & Team Management

Lead and mentor a team of data engineers.

Review architecture, code, and data models for quality and consistency.

Define and promote best practices, reusable frameworks, and standards.

Serve as the technical authority for Azure data initiatives.

5. Collaboration & Business Alignment

Work closely with data scientists, BI teams, and business stakeholders.

Translate business needs into scalable technical solutions.

Optimize data workloads for cost, performance, and scalability.

Communicate technical concepts clearly to non-technical audiences.

Core Technical Skills

Azure Services : Data Factory, Databricks (PySpark, Delta Lake), Synapse Analytics, ADLS Gen2, Event Hubs / Kafka, Purview / Microsoft Fabric, Azure Functions, Logic Apps.

Languages : Python (mandatory), SQL, Scala.

Frameworks & Tools : PySpark, Pandas, dbt (optional), Git / GitHub, Azure DevOps, Terraform / Bicep / ARM.

Data Modeling : Star / Snowflake schema, Data Vault 2.0, dimensional modeling.

Databases : Azure SQL DB, Cosmos DB, PostgreSQL, SAP / Oracle integrations.

Integrations : Power BI, Azure ML, external BI / AI systems.

Create a job alert for this search

Lead Data Engineer • India

Related jobs

Promoted

AI / ML & Data Engineer

Mindfire SolutionsNagpur, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Kline + CompanyNagpur, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 26 days ago

Promoted

Lead Data Engineer

ITQube LTDnagpur, maharashtra, in

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago

Promoted
New!

Azure Data Engineer

9NEXUSNagpur, IN

Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 21 hours ago

Promoted

Data Engineer

TalogyNagpur, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeNagpur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Searce IncNagpur, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 21 days ago

Promoted

Data Engineer

Manuh TechnologiesNagpur, IN

S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RevXNagpur, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

GEMRAJ TECHNOLOGIES LIMITEDNagpur, IN

We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 3 days ago

Promoted
New!

Data Engineer

BrothersTechNagpur, IN

Remote (Night Shift - Flexible).Must have excellent English written and verbal communication skills.The ideal candidate should be experienced in data engineering on. Snowflake Azure -ADF, Microsoft ...Show moreLast updated: 21 hours ago

Promoted
New!

Senior Data Engineer

Coffeee.ioNagpur, IN

Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 21 hours ago

Promoted
New!

lead Data Engineer

CozzeraNagpur, IN

Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 21 hours ago

Promoted

Data Engineer

V2Softnagpur, maharashtra, in

Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 11 days ago

Promoted

GenAI Lead Engineer (Investment Data Platforms)

Vichara Technologiesnagpur, maharashtra, in

We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Saras AnalyticsIndia

About Saras Analytics : We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.Our suite of work spans ex...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionNagpur, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago

Promoted

Lead Data Engineer

EverestDX IncIndia

About the Company : Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered ana...Show moreLast updated: 21 days ago

Promoted
New!

Senior Data Engineer

AIQUNagpur, IN

We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 21 hours ago

Promoted

Freelance Data Engineer

upGradNagpur, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 9 days ago