lead Data Engineer
CozzeraPune, IN1 day ago
Job descriptionOversee the development and optimization of ETL / ELT pipelines using Python and Drive data platform modernization and migration to cloud-native architectures Collaborate with Data Scientists, Analysts, and Architects to enable advanced Establish and enforce data engineering standards, best practices, and code reviews Ensure data governance, lineage, and compliance with regulatory frameworks Manage performance tuning, cost optimization, and scalability planning for data Mentor and guide junior data engineers, fostering a culture of technical excellence. Partner with stakeholders to align business objectives with data strategy and delivery Languages : Python, SQL, PySpark Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark Workflow Orchestration : Airflow, Prefect, Dagster Cloud Platforms : AWS, Azure, or GCP (with focus on data services) Data Architecture : Data Lakes, Warehouses, and Streaming Architectures DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines Governance & Security : HIPAA, SOC 2, GDPR compliance expertise Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools Proven leadership and mentorship capabilities Excellent communication and client interaction skills Strategic mindset with strong analytical and problem-solving ability Ability to manage multiple projects and distributed teams in Agile environments Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
Job Title : Lead Data Engineer
Experience : 8–10 Years
Location : Remote ( 1 week from noida office then remote)
Job Overview :
We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in
architecting, building, and managing complex data ecosystems using Python, Databricks
(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should
possess strong leadership and technical acumen to drive data strategy, pipeline
optimization, and AI / ML workflow automation across large-scale projects.
The role involves architecting scalable data solutions, ensuring data governance and
compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high
performance solutions in healthcare or life sciences domains.
Key Responsibilities :
- Lead the architecture, design, and implementation of scalable and reliable data
solutions using Databricks, Delta Lake, and Spark.
modern orchestration tools (Airflow, Prefect, Dagster).
(AWS, Azure, or GCP).
analytics and ML model deployment using MLflow.
across teams.
(HIPAA, SOC 2, GDPR).
workflows.
roadmap.
Technical Skills Required :
Soft Skills :
Education :
Chances of Closure
Yes
Create a job alert for this search
Lead Data Engineer • Pune, IN
Related jobs
- Promoted
Azure Data Engineer
9NEXUSPune, IN Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment.
The role involves building high-perf...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
VeraxionPune, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
thinkbridgePune, Maharashtra, India We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
ITC InfotechPune, Maharashtra, India Maintenance and support of Data Pipeline.Data Validation and quality checks.Identify and optimize ingestion pipelines in consultation with Customer.
Investigate Glue job failures and restart.Fix min...Show moreLast updated: 21 days ago
- Promoted
Data Engineer
VAANTECHpune, maharashtra, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
AIQUPune, IN We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable.
The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Manuh TechnologiesPune, IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer Lead
CoforgePune, Maharashtra, India We are Hiring : AWS Data Engineer Lead at Coforge Ltd.Interested candidates can share their updated CV at : .The ideal candidate will have a proven track record of designing, building, and maintaining...Show moreLast updated: 21 days ago
- Promoted
Lead Data Engineer
Searce IncPune, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 22 days ago
- Promoted
Data Engineer Lead
Calfus Inc.Pune, Maharashtra, India As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven d...Show moreLast updated: 8 days ago
- Promoted
Lead Data Engineer
ITQube LTDPune, Maharashtra, India Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago
- Promoted
2917 - Data Engineer
EXLpune, maharashtra, in The Data Engineer is responsible for designing, building, and optimizing data systems that power analytics, reporting, and machine learning across the organization.
The role involves developing scal...Show moreLast updated: 1 day ago
- Promoted
- New!
▷ (27 / 10 / 2025) Data Engineer Lead
Calfus Inc.Pune, Maharashtra, India About the role : As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to m...Show moreLast updated: 1 hour ago
- Promoted
Data Engineer / Tech Lead - Big Data Technologies
CliqHRPune Job Title : Tech Lead We are seeking a dynamic and experienced Tech Lead with a strong foundation in Java and Apache Spark to join our team.In this role, you will le...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer Lead
CoffeeBeansPune, Maharashtra, India Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance.
Good communication and leadership sk...Show moreLast updated: 19 days ago
- Promoted
GenAI Lead Engineer (Investment Data Platforms)
Vichara Technologiespune, maharashtra, in We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers.
Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer - Synapse Analytics
iTechMinds Consulting LLPPune Job Description : We are seeking a highly skilled Azure Data Engineer to join our dynamic team.As a Data Engineer at LUMIQ, you will play a crucial role in designing...Show moreLast updated: 30+ days ago
- Promoted
Lead Big Data Engineer - Spark
QUALYS SECURITY TECHSERVICES PRIVATE LIMITEDPune Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!.Description : We are seeking a talented Lead Big ...Show moreLast updated: 30+ days ago