Talent.com
Lead Data Engineer
Lead Data EngineerEXL • pune, maharashtra, in
Lead Data Engineer

Lead Data Engineer

EXL • pune, maharashtra, in
6 days ago
Job description

About the Role

We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions. The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced environment.

Key Responsibilities

Leadership & Team Management

  • Lead and mentor a team of onshore and offshore data engineers to ensure high-quality deliverables.
  • Provide technical direction, coaching, and knowledge sharing to foster team growth and capability building.
  • Establish and enforce engineering best practices, coding standards, and reusable frameworks.
  • Champion innovation, continuous learning, and thought leadership within the data engineering function.

Project Delivery & Execution

  • Oversee end-to-end project delivery, ensuring timely, high-quality execution aligned with project objectives.
  • Define high-level solution designs, data architectures, and ETL / ELT frameworks for cloud-based data platforms.
  • Drive development, code reviews, unit testing, and deployment to production environments.
  • Ensure optimal performance, scalability, and reliability across data pipelines and systems.
  • Stakeholder Communication & Collaboration

  • Collaborate with clients, product owners, business leaders, and offshore teams to gather requirements and define technical solutions.
  • Communicate project updates, timelines, risks, and technical concepts effectively to both technical and non-technical stakeholders.
  • Act as the primary point of contact for client technical discussions, solution design workshops, and progress reviews.
  • Risk & Issue Management

  • Proactively identify project risks, dependencies, and issues; develop and execute mitigation plans.
  • Ensure governance, compliance, and alignment with organizational standards and methodologies.
  • Must-Have Skills

  • 12+ years of experience in Data Engineering with proven experience in delivering enterprise-scale projects.
  • Strong expertise in Big Data concepts , distributed systems, and cloud-native architectures.
  • Proficiency in Snowflake, SQL , and a wide range of AWS services (Glue, EMR, S3, Aurora, RDS, Lambda, Step Functions).
  • Hands-on experience with Python, PySpark , and building cloud-based microservices.
  • Strong problem-solving, analytical skills, and end-to-end ownership mindset.
  • Proven ability to work in Agile / Scrum environments with iterative delivery cycles.
  • Exceptional communication, leadership, and stakeholder management skills .
  • Demonstrated capability in leading onshore–offshore teams and coordinating multi-region delivery efforts.
  • Good-to-Have Skills

  • Experience with DevOps tools (Jenkins, Git, GitHub / GitLab) and CI / CD pipeline implementation.
  • Experience with cloud migration and large-scale modernization projects.
  • Familiarity with the US insurance / reinsurance domain + P&C Insurance knowledge
  • Knowledge of Data Vault 2.0 and modern data modeling techniques.
  • Create a job alert for this search

    Lead Data Engineer • pune, maharashtra, in

    Related jobs
    Data Engineer

    Data Engineer

    Recro • Pune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Pune, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Pune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 11 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXL • Pune, Maharashtra, India
    We are seeking a highly skilled.The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced envir...Show more
    Last updated: 6 days ago • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent Systems • pune, maharashtra, in
    We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Corporate Steps • Pune
    Description : This role is for a highly skilled and experienced Data Pipeline Architect / Lead Engineer responsible for setting the technical direction and leading the...Show more
    Last updated: 1 day ago • Promoted
    Reveille Technologies - Big Data Engineer

    Reveille Technologies - Big Data Engineer

    Reveille Technologies • Pune
    Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune, Maharashtra, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
    Last updated: 29 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Pune, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 12 days ago • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXL • Pune, Maharashtra, India
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 6 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Bajaj Technology Services • Pune, Maharashtra, India
    Domain : eCommerce / Financial Reconciliation.Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support...Show more
    Last updated: 13 hours ago • Promoted • New!