lead Data Engineer
CozzeraPrayagraj(Allahabad), IN9 hours ago
Job descriptionOversee the development and optimization of ETL / ELT pipelines using Python and Drive data platform modernization and migration to cloud-native architectures Collaborate with Data Scientists, Analysts, and Architects to enable advanced Establish and enforce data engineering standards, best practices, and code reviews Ensure data governance, lineage, and compliance with regulatory frameworks Manage performance tuning, cost optimization, and scalability planning for data Mentor and guide junior data engineers, fostering a culture of technical excellence. Partner with stakeholders to align business objectives with data strategy and delivery Languages : Python, SQL, PySpark Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark Workflow Orchestration : Airflow, Prefect, Dagster Cloud Platforms : AWS, Azure, or GCP (with focus on data services) Data Architecture : Data Lakes, Warehouses, and Streaming Architectures DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines Governance & Security : HIPAA, SOC 2, GDPR compliance expertise Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools Proven leadership and mentorship capabilities Excellent communication and client interaction skills Strategic mindset with strong analytical and problem-solving ability Ability to manage multiple projects and distributed teams in Agile environments Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
Job Title : Lead Data Engineer
Experience : 8–10 Years
Location : Remote ( 1 week from noida office then remote)
Job Overview :
We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in
architecting, building, and managing complex data ecosystems using Python, Databricks
(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should
possess strong leadership and technical acumen to drive data strategy, pipeline
optimization, and AI / ML workflow automation across large-scale projects.
The role involves architecting scalable data solutions, ensuring data governance and
compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high
performance solutions in healthcare or life sciences domains.
Key Responsibilities :
- Lead the architecture, design, and implementation of scalable and reliable data
solutions using Databricks, Delta Lake, and Spark.
modern orchestration tools (Airflow, Prefect, Dagster).
(AWS, Azure, or GCP).
analytics and ML model deployment using MLflow.
across teams.
(HIPAA, SOC 2, GDPR).
workflows.
roadmap.
Technical Skills Required :
Soft Skills :
Education :
Chances of Closure
Yes
Create a job alert for this search
Lead Data Engineer • Prayagraj(Allahabad), IN
Related jobs
- Promoted
Data Engineer
Kline + CompanyPrayagraj(Allahabad), IN Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
True Tech ProfessionalsPrayagraj(Allahabad), IN SQL, Python, and data engineering tools.Presto, Dig-Dag, workflow managers) within.Customer Data Platform (CDP) technologies.
Design, implement, and optimize.Develop, schedule, and monitor ETL jobs....Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Manuh TechnologiesPrayagraj(Allahabad), IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Searce IncPrayagraj(Allahabad), IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 21 days ago
- Promoted
- New!
Lead Data Engineer GCP
EgenPrayagraj(Allahabad), IN We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 9 hours ago
- Promoted
- New!
Data Engineer
VeraxionPrayagraj(Allahabad), IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 15 hours ago
- Promoted
- New!
Sr. Data Engineer – AWS Databricks / Data Tech Lead
Gravity Infosolutions, Inc.Prayagraj(Allahabad), IN Data Engineer – AWS Databricks / Data Tech Lead.Duration : 3 Months+ Extendable.Design and implement robust ETL / ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unst...Show moreLast updated: 9 hours ago
- Promoted
- New!
Senior Data Engineer
AIQUPrayagraj(Allahabad), IN We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable.
The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 9 hours ago
- Promoted
- New!
Senior / Lead Data Engineer
People Prime WorldwidePrayagraj(Allahabad), IN Senior & Lead Data Engineer – Python & GCP.We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our dat...Show moreLast updated: 9 hours ago
- Promoted
- New!
Data Engineer
BrothersTechPrayagraj(Allahabad), IN Remote (Night Shift - Flexible).Must have excellent English written and verbal communication skills.The ideal candidate should be experienced in data engineering on.
Snowflake Azure -ADF, Microsoft ...Show moreLast updated: 9 hours ago
- Promoted
Data Engineer
RevXPrayagraj(Allahabad), IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
- New!
Azure Data Engineer
9NEXUSPrayagraj(Allahabad), IN Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment.
The role involves building high-perf...Show moreLast updated: 9 hours ago
- Promoted
- New!
ETL Data Engineer
BPMLinksPrayagraj(Allahabad), IN In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show moreLast updated: 9 hours ago
- Promoted
- New!
Senior Data Engineer
Futran SolutionsPrayagraj(Allahabad), IN Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 9 hours ago
- Promoted
Data Engineer
People Prime WorldwidePrayagraj(Allahabad), IN Our client is a global technology consulting and digital solutions company, resulting from the merger.It focuses on helping businesses leverage digital technologies to reimagine business models, ac...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
TalogyPrayagraj(Allahabad), IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
Coffeee.ioPrayagraj(Allahabad), IN Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 9 hours ago
- Promoted
- New!
Data Engineer
Cephei InfotechPrayagraj(Allahabad), IN Data Engineer (SQL & Python Expertise Required).Data & Analytics-focused IT company.ETL workflows, and analytical solutions.
GenAI, OpenCV, or Machine Learning.Integrate data from multiple sources (...Show moreLast updated: 9 hours ago