No longer accepting applications

Lead Data Engineer (AWS) | Lead Data Engineer | BFSI / Data & Analytics | 6–12 years | Noida | Max Budget 32 LPA

Unicorn Workforce • Noida, Uttar Pradesh, India

5 days ago

Job description

About the Role

We are looking for an experienced Lead Data Engineer to design, build, and optimize cloud-native data platforms on AWS. You will lead a team of Data Engineers and drive end-to-end development of scalable data pipelines, modern data architectures, and enterprise-grade data solutions for BFSI customers.

This is a hands-on role with strong ownership across architecture, development, optimisation, and team leadership.

Key Responsibilities

Leadership & Delivery

Lead, mentor, and manage a team of Data Engineers to deliver high-quality outcomes.
Own project planning, task delegation, sprint delivery, and quality assurance.
Collaborate with cross-functional teams including data scientists, analysts, architects, and product teams.

Data Engineering & Architecture

Architect, design, and implement scalable data pipelines using AWS, PySpark, and Airflow .

Build and maintain ETL / ELT processes for ingestion, transformation, and publishing of structured / unstructured data.

Develop scalable data models and cloud-native architectures aligned with BFSI requirements.

Optimize data processing (Spark), data storage (S3, Iceberg / Hudi / Delta), and query performance.

Cloud & Platform Engineering

Work across AWS services such as S3, Glue, EMR, Lambda, Redshift, Kinesis, RDS, CloudWatch, IAM.

Ensure cost-efficiency, reliability, and scalability of the cloud data environment.

Implement automation for CI / CD, data deployments, and pipeline orchestration.

Governance, Security & Compliance

Enforce data governance standards, lineage tracking, and data quality frameworks.

Implement data security, encryption, RBAC, and compliance aligned with BFSI / regulatory norms.

Ensure high availability, monitoring, and proactive issue resolution.

Required Skills & Experience

Core Technical Skills

6+ years of hands-on experience in data engineering.

Strong expertise in PySpark for distributed data processing.

Experience building and orchestrating pipelines using Airflow (DAGs, scheduling, monitoring).

Strong AWS experience with focus on data services.

Advanced SQL skills and experience in OLTP, OLAP, Data Lakes, and Data Warehouses.

Experience with Hudi / Iceberg / Delta Lake .

Proficiency in Python for ETL, utilities, and API integrations.

Understanding of big data technologies (Spark, Hadoop ecosystem).

Preferred Skills

Experience in BFSI (Banking, Insurance, NBFCs, AMCs) data ecosystems.

Exposure to Docker, Kubernetes, and containerized data applications.

API development experience (preferably Python / FastAPI / Flask).

Experience working with data scientists and BI teams.

Behavioral & Leadership Skills

Strong ownership mindset and accountability.

Excellent problem solving and debugging skills.

Ability to mentor junior team members and lead by example.

Strong communication and stakeholder management.

Ability to work in a fast-paced, entrepreneurial environment.

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

Create a job alert for this search

Lead Data Engineer • Noida, Uttar Pradesh, India

Related jobs

Lead Data Engineer

MakeMyTrip • Gurugram, Haryana, India

At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Recro • Delhi, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

IGT Solutions • Gurugram, Haryana, India

We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Baazi Games • New Delhi, Delhi, India

Job Title : Data Engineer III Location : Delhi (Hybrid) Department : Data Engineering Reports To : Engineering Manager – Data Platform About the Role The Data Engineer III will lead the design and op...Show more

Last updated: 11 days ago • Promoted

Data Engineer

NAB • Gurugram, Haryana, India

Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show more

Last updated: 1 day ago • Promoted

Senior Data Engineer

SAIVA AI • Delhi, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Atyeti Inc • Delhi, India

Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more

Last updated: 5 days ago • Promoted

Data Engineer

Tata Consultancy Services • Ghaziabad, IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more

Last updated: 30+ days ago • Promoted

AWS Lead Data engineer

Tata Consultancy Services • Delhi, India

In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more

Last updated: 17 days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • Delhi, India, India

Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Insight Global • Delhi, India

We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experie...Show more

Last updated: 17 days ago • Promoted

Data Engineer

Insight Global • Delhi, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Lead Data Engineer (Databricks)

SII Group India • Noida, Uttar Pradesh, India

About the Role We are looking for a highly skilled Data Engineer with strong hands-on experience in Databricks, PySpark, GCP , and cloud data infrastructure. The ideal candidate will be responsi...Show more

Last updated: 1 day ago • Promoted

Lead Data Engineer

VRIZE • Delhi, India

Experience as a Data Engineer with strong track record of designing and implementing data solutions.Experience in programming language as Python, Pyspark with airflows Experience with cloud data wa...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Natlov Technologies Pvt Ltd • Delhi, India, India

Hiring : Cloud Data Engineer | Remote | Full-Time | Immediate Joiner.Ltd is looking for a Cloud Data Engineer with strong AWS expertise and working experience in Azure. In this role, you will design,...Show more

Last updated: 5 days ago • Promoted

Lead GCP Data Engineer

Impetus • Gurugram, Haryana, India

Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show more

Last updated: 1 day ago • Promoted

AWS Data Engineer

Tata Consultancy Services • Delhi, India, India

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more

Last updated: 28 days ago • Promoted

Senior Data Engineer

KOGTA FINANCIAL (INDIA) LIMITED • Gurugram, Haryana, India

ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more

Last updated: 1 day ago • Promoted