lead Data Engineer

CozzeraIndia, India

1 day ago

Job description

Job Title : Lead Data Engineer

Experience : 8–10 Years

Location : Remote ( 1 week from noida office then remote)

Job Overview :

We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in

architecting, building, and managing complex data ecosystems using Python, Databricks

(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should

possess strong leadership and technical acumen to drive data strategy, pipeline

optimization, and AI / ML workflow automation across large-scale projects.

The role involves architecting scalable data solutions, ensuring data governance and

compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high

performance solutions in healthcare or life sciences domains.

Key Responsibilities :

Lead the architecture, design, and implementation of scalable and reliable data

solutions using Databricks, Delta Lake, and Spark.

Oversee the development and optimization of ETL / ELT pipelines using Python and

modern orchestration tools (Airflow, Prefect, Dagster).

Drive data platform modernization and migration to cloud-native architectures

(AWS, Azure, or GCP).

Collaborate with Data Scientists, Analysts, and Architects to enable advanced

analytics and ML model deployment using MLflow.

Establish and enforce data engineering standards, best practices, and code reviews

across teams.

Ensure data governance, lineage, and compliance with regulatory frameworks

(HIPAA, SOC 2, GDPR).

Manage performance tuning, cost optimization, and scalability planning for data

workflows.

Mentor and guide junior data engineers, fostering a culture of technical excellence.

Partner with stakeholders to align business objectives with data strategy and delivery

roadmap.

Technical Skills Required :

Languages : Python, SQL, PySpark

Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark

Workflow Orchestration : Airflow, Prefect, Dagster

Cloud Platforms : AWS, Azure, or GCP (with focus on data services)

Data Architecture : Data Lakes, Warehouses, and Streaming Architectures

DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines

Governance & Security : HIPAA, SOC 2, GDPR compliance expertise

Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools

Soft Skills :

Proven leadership and mentorship capabilities

Excellent communication and client interaction skills

Strategic mindset with strong analytical and problem-solving ability

Ability to manage multiple projects and distributed teams in Agile environments

Education :

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Chances of Closure

Yes

Create a job alert for this search

Lead Data Engineer • India, India

Related jobs

Promoted

Data Engineer

Kline + CompanyNagpur, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 28 days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsNagpur, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Randstad EnterpriseNagpur, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AINagpur, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 21 days ago

Promoted

GCP Data Engineer

EXLNagpur, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 13 days ago

Promoted

Data Engineer

VeraxionIndia

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 2 days ago

Promoted

Data Engineer

TalogyIndia, India

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - Scala

Idyllic ServicesNagpur, IN

Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 11 days ago

Promoted

Senior AWS Data Engineer

CYAN360Nagpur, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeNagpur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Nityo InfotechNagpur, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 2 days ago

Promoted

Lead Data Engineer

Searce IncIndia

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer

Coffeee.ioNagpur, IN

Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 2 days ago

Promoted

Data Engineer

RevXNagpur, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer

TerraGiGNagpur, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 2 days ago

Promoted

Data Engineer

AAA GlobalNagpur, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

SAIVA AINagpur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

AIQUIndia, India

We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 2 days ago

Promoted

Freelance Data Engineer

upGradNagpur, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 11 days ago

Promoted

Data Engineer_Immediate Joiners

VXI Global SolutionsNagpur, IN

VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 13 days ago