No longer accepting applications
lead Data Engineer
CozzeraKolkata, IN5 days ago
Job descriptionOversee the development and optimization of ETL / ELT pipelines using Python and Drive data platform modernization and migration to cloud-native architectures Collaborate with Data Scientists, Analysts, and Architects to enable advanced Establish and enforce data engineering standards, best practices, and code reviews Ensure data governance, lineage, and compliance with regulatory frameworks Manage performance tuning, cost optimization, and scalability planning for data Mentor and guide junior data engineers, fostering a culture of technical excellence. Partner with stakeholders to align business objectives with data strategy and delivery Languages : Python, SQL, PySpark Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark Workflow Orchestration : Airflow, Prefect, Dagster Cloud Platforms : AWS, Azure, or GCP (with focus on data services) Data Architecture : Data Lakes, Warehouses, and Streaming Architectures DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines Governance & Security : HIPAA, SOC 2, GDPR compliance expertise Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools Proven leadership and mentorship capabilities Excellent communication and client interaction skills Strategic mindset with strong analytical and problem-solving ability Ability to manage multiple projects and distributed teams in Agile environments Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
Job Title : Lead Data Engineer
Experience : 8–10 Years
Location : Remote ( 1 week from noida office then remote)
Job Overview :
We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in
architecting, building, and managing complex data ecosystems using Python, Databricks
(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should
possess strong leadership and technical acumen to drive data strategy, pipeline
optimization, and AI / ML workflow automation across large-scale projects.
The role involves architecting scalable data solutions, ensuring data governance and
compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high
performance solutions in healthcare or life sciences domains.
Key Responsibilities :
- Lead the architecture, design, and implementation of scalable and reliable data
solutions using Databricks, Delta Lake, and Spark.
modern orchestration tools (Airflow, Prefect, Dagster).
(AWS, Azure, or GCP).
analytics and ML model deployment using MLflow.
across teams.
(HIPAA, SOC 2, GDPR).
workflows.
roadmap.
Technical Skills Required :
Soft Skills :
Education :
Chances of Closure
Yes
Create a job alert for this search
Lead Data Engineer • Kolkata, IN
Related jobs
- Promoted
GCP Data Engineer
EXLKolkata, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 16 days ago
- Promoted
Lead Data Engineer
Searce IncKolkata, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 26 days ago
- Promoted
Freelance Data Engineer
upGradKolkata, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 14 days ago
- Promoted
Senior Data Engineer
HealthyMe AIKolkata, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
Randstad EnterpriseKolkata, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIKolkata, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPKolkata, IN Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer(ETL ODI) Contract
Vienna ConsultancyKolkata, IN Contract- 6 months (Extendable).Shift timings- Night shift- 9 pm IST to 6 am IST.Design, develop, and maintain functions and stored procedures using Oracle Data Integrator (ODI).Create and document...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
Sikich IndiaKolkata, IN Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RevXKolkata, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VeraxionKolkata, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
- Promoted
AWS Data Engineer
TerraGiGKolkata, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 6 days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global SolutionsKolkata, IN VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
Response InformaticsKolkata, IN We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 16 days ago
- Promoted
AI / ML & Data Engineer
Mindfire SolutionsKolkata, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
IntraEdgeKolkata, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
AAA GlobalKolkata, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
- Promoted
Senior AWS Data Engineer
CYAN360Kolkata, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago