Talent.com
lead Data Engineer

lead Data Engineer

CozzeraAhmedabad, IN
15 hours ago
Job description

Job Title : Lead Data Engineer

Experience : 8–10 Years

Location : Remote ( 1 week from noida office then remote)

Job Overview :

We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in

architecting, building, and managing complex data ecosystems using Python, Databricks

(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should

possess strong leadership and technical acumen to drive data strategy, pipeline

optimization, and AI / ML workflow automation across large-scale projects.

The role involves architecting scalable data solutions, ensuring data governance and

compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high

performance solutions in healthcare or life sciences domains.

Key Responsibilities :

  • Lead the architecture, design, and implementation of scalable and reliable data

solutions using Databricks, Delta Lake, and Spark.

  • Oversee the development and optimization of ETL / ELT pipelines using Python and
  • modern orchestration tools (Airflow, Prefect, Dagster).

  • Drive data platform modernization and migration to cloud-native architectures
  • (AWS, Azure, or GCP).

  • Collaborate with Data Scientists, Analysts, and Architects to enable advanced
  • analytics and ML model deployment using MLflow.

  • Establish and enforce data engineering standards, best practices, and code reviews
  • across teams.

  • Ensure data governance, lineage, and compliance with regulatory frameworks
  • (HIPAA, SOC 2, GDPR).

  • Manage performance tuning, cost optimization, and scalability planning for data
  • workflows.

  • Mentor and guide junior data engineers, fostering a culture of technical excellence.
  • Partner with stakeholders to align business objectives with data strategy and delivery
  • roadmap.

    Technical Skills Required :

  • Languages : Python, SQL, PySpark
  • Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark
  • Workflow Orchestration : Airflow, Prefect, Dagster
  • Cloud Platforms : AWS, Azure, or GCP (with focus on data services)
  • Data Architecture : Data Lakes, Warehouses, and Streaming Architectures
  • DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines
  • Governance & Security : HIPAA, SOC 2, GDPR compliance expertise
  • Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools
  • Soft Skills :

  • Proven leadership and mentorship capabilities
  • Excellent communication and client interaction skills
  • Strategic mindset with strong analytical and problem-solving ability
  • Ability to manage multiple projects and distributed teams in Agile environments
  • Education :

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
  • Chances of Closure

    Yes

    Create a job alert for this search

    Lead Data Engineer • Ahmedabad, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesAnand, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyAhmedabad, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    BrothersTechGandhinagar, IN
    Remote (Night Shift - Flexible).Must have excellent English written and verbal communication skills.The ideal candidate should be experienced in data engineering on. Snowflake Azure -ADF, Microsoft ...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXGandhinagar, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioGandhinagar, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 15 hours ago
    • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologiesahmedabad, gujarat, in
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VeraxionGandhinagar, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 21 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Azilen TechnologiesAhmedabad, Gujarat, India
    Manage and create design schema, SQL query tuning, and code review.Min 3+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeGandhinagar, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDahmedabad, gujarat, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softgandhinagar, gujarat, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 11 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncNadiad, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyAnand, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AIQUAnand, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Cephei InfotechAhmedabad, Gujarat, India
    Data Engineer (SQL & Python Expertise Required).Data & Analytics-focused IT company.ETL workflows, and analytical solutions. GenAI, OpenCV, or Machine Learning.Integrate data from multiple sources (...Show moreLast updated: 5 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    S&P GlobalAhmedabad, India
    Grade Level (for internal use) : .The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering,...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHnadiad, gujarat, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    lead Data Engineer

    lead Data Engineer

    CozzeraNadiad, IN
    Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RK HR Management Private LimitedAhmedabad, Gujarat, India
    Design and build scalable data pipeline architecture that can handle large volumes of data.Develop ELT / ETL pipelines to extract, load and transform data from various sources into our data warehouse...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    9NEXUSAnand, IN
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 14 hours ago