Talent.com
lead Data Engineer

lead Data Engineer

CozzeraBangalore, IN
15 hours ago
Job description

Job Title : Lead Data Engineer

Experience : 8–10 Years

Location : Remote ( 1 week from noida office then remote)

Job Overview :

We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in

architecting, building, and managing complex data ecosystems using Python, Databricks

(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should

possess strong leadership and technical acumen to drive data strategy, pipeline

optimization, and AI / ML workflow automation across large-scale projects.

The role involves architecting scalable data solutions, ensuring data governance and

compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high

performance solutions in healthcare or life sciences domains.

Key Responsibilities :

  • Lead the architecture, design, and implementation of scalable and reliable data

solutions using Databricks, Delta Lake, and Spark.

  • Oversee the development and optimization of ETL / ELT pipelines using Python and
  • modern orchestration tools (Airflow, Prefect, Dagster).

  • Drive data platform modernization and migration to cloud-native architectures
  • (AWS, Azure, or GCP).

  • Collaborate with Data Scientists, Analysts, and Architects to enable advanced
  • analytics and ML model deployment using MLflow.

  • Establish and enforce data engineering standards, best practices, and code reviews
  • across teams.

  • Ensure data governance, lineage, and compliance with regulatory frameworks
  • (HIPAA, SOC 2, GDPR).

  • Manage performance tuning, cost optimization, and scalability planning for data
  • workflows.

  • Mentor and guide junior data engineers, fostering a culture of technical excellence.
  • Partner with stakeholders to align business objectives with data strategy and delivery
  • roadmap.

    Technical Skills Required :

  • Languages : Python, SQL, PySpark
  • Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark
  • Workflow Orchestration : Airflow, Prefect, Dagster
  • Cloud Platforms : AWS, Azure, or GCP (with focus on data services)
  • Data Architecture : Data Lakes, Warehouses, and Streaming Architectures
  • DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines
  • Governance & Security : HIPAA, SOC 2, GDPR compliance expertise
  • Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools
  • Soft Skills :

  • Proven leadership and mentorship capabilities
  • Excellent communication and client interaction skills
  • Strategic mindset with strong analytical and problem-solving ability
  • Ability to manage multiple projects and distributed teams in Agile environments
  • Education :

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
  • Chances of Closure

    Yes

    Create a job alert for this search

    Lead Data Engineer • Bangalore, IN

    Related jobs
    • Promoted
    Lead Data Engineer – Snowflake & dbt

    Lead Data Engineer – Snowflake & dbt

    LumenDataBengaluru, Karnataka, India
    Lead Data Engineer – Snowflake & dbt.LumenData is a leading consulting firm specializing in enterprise data management, analytics, and cloud modernization. We partner with clients across industries ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AIQUhosur, tamil nadu, in
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 8 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, Karnataka, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 26 days ago
    • Promoted
    Lead Data Engineer [T500-20510]

    Lead Data Engineer [T500-20510]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Lead-Data Engineer

    Technical Lead-Data Engineer

    Best Infosystems Ltd.Bengaluru, Karnataka, India
    Technical Lead-Data Engineer_Full-Time_Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai.Bangalore / Pune / Navi Mumbai / Noida / Hyderabad / Chennai. Bachelor’s / relevant exp - with Snowpro Certification.Ent...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer / Lead / Architect

    Senior Data Engineer / Lead / Architect

    Aezion, IncBengaluru, Karnataka, India
    Aezion is a mission-driven growing company fueled by our Purpose and guided by our values (Love, Dependability, Humble, Diversity, Speed and Innovation). Our Values drive how we go about that existe...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncBengaluru, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgehosur, tamil nadu, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softhosur, tamil nadu, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer-Technical Lead

    Data Engineer-Technical Lead

    SigmoidBengaluru, Karnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Veraxionhosur, tamil nadu, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 16 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyhosur, tamil nadu, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Talogyhosur, tamil nadu, in
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Minimum of 8-10 years of relevant data science, Business Intelligence, or data analytics experience – preferably with a digital media or digital advertising company. Experience delivering products i...Show moreLast updated: 11 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDhosur, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago