Talent.com
Lead Data Engineer
Lead Data EngineerEXL • pune, maharashtra, in
Lead Data Engineer

Lead Data Engineer

EXL • pune, maharashtra, in
8 days ago
Job description

About the Role

We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions. The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced environment.

Key Responsibilities

Leadership & Team Management

  • Lead and mentor a team of onshore and offshore data engineers to ensure high-quality deliverables.
  • Provide technical direction, coaching, and knowledge sharing to foster team growth and capability building.
  • Establish and enforce engineering best practices, coding standards, and reusable frameworks.
  • Champion innovation, continuous learning, and thought leadership within the data engineering function.

Project Delivery & Execution

  • Oversee end-to-end project delivery, ensuring timely, high-quality execution aligned with project objectives.
  • Define high-level solution designs, data architectures, and ETL / ELT frameworks for cloud-based data platforms.
  • Drive development, code reviews, unit testing, and deployment to production environments.
  • Ensure optimal performance, scalability, and reliability across data pipelines and systems.
  • Stakeholder Communication & Collaboration

  • Collaborate with clients, product owners, business leaders, and offshore teams to gather requirements and define technical solutions.
  • Communicate project updates, timelines, risks, and technical concepts effectively to both technical and non-technical stakeholders.
  • Act as the primary point of contact for client technical discussions, solution design workshops, and progress reviews.
  • Risk & Issue Management

  • Proactively identify project risks, dependencies, and issues; develop and execute mitigation plans.
  • Ensure governance, compliance, and alignment with organizational standards and methodologies.
  • Must-Have Skills

  • 12+ years of experience in Data Engineering with proven experience in delivering enterprise-scale projects.
  • Strong expertise in Big Data concepts , distributed systems, and cloud-native architectures.
  • Proficiency in Snowflake, SQL , and a wide range of AWS services (Glue, EMR, S3, Aurora, RDS, Lambda, Step Functions).
  • Hands-on experience with Python, PySpark , and building cloud-based microservices.
  • Strong problem-solving, analytical skills, and end-to-end ownership mindset.
  • Proven ability to work in Agile / Scrum environments with iterative delivery cycles.
  • Exceptional communication, leadership, and stakeholder management skills .
  • Demonstrated capability in leading onshore–offshore teams and coordinating multi-region delivery efforts.
  • Good-to-Have Skills

  • Experience with DevOps tools (Jenkins, Git, GitHub / GitLab) and CI / CD pipeline implementation.
  • Experience with cloud migration and large-scale modernization projects.
  • Familiarity with the US insurance / reinsurance domain + P&C Insurance knowledge
  • Knowledge of Data Vault 2.0 and modern data modeling techniques.
  • Create a job alert for this search

    Lead Data Engineer • pune, maharashtra, in

    Related jobs
    Data Engineer

    Data Engineer

    IntraEdge • Pune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Pune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Pune, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 14 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Pune, India
    Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we're helping build a sustainable economy where everyone can prosper.We supp...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 11 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXL • Pune, Maharashtra, India
    We are seeking a highly skilled.The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced envir...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Pune, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune, Maharashtra, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 20 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Bajaj Technology Services • Pune, Maharashtra, India
    Domain : eCommerce / Financial Reconciliation.Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    METRO / MAKRO • Pune, Maharashtra, India
    Take ownership of the technical direction and execution of machine learning projects within the Data Science team; .Mentor and support junior engineers and data scientists enabling their growt...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Analytics Engineer

    Lead Data Analytics Engineer

    Confidential • Pune, India
    ICE Data Services (an Intercontinental Exchange company) is seeking strong candidates to join its Spatial Intelligence team. This hire will be an immediate contributor to an ambitious roadmap in US ...Show more
    Last updated: 9 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Fusemachines • Pune, IN
    Quick Apply
    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizin...Show more
    Last updated: 30+ days ago