Talent.com
Lead - Data Engineering

Lead - Data Engineering

WorksconsultancyPune
1 day ago
Job description

Overview We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in building scalable data solutions on the Azure ecosystem.

The ideal candidate will have strong hands-on expertise in Databricks, Spark (Java), modern data lake architectures, and end-to-end ETL development.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines using Azure and Databricks.
  • Build efficient ingestion and transformation workflows using Databricks with Pyspark and Delta Lake
  • Develop and optimize ETL pipelines using Java and SQL.
  • Implement best practices for data modeling, data quality, governance, and pipeline performance.
  • Work with relational and lakehouse databases including PostgreSQL and Delta Lake.
  • Collaborate with cross-functional teams and support production workloads, troubleshooting, and optimization.

Required Skills & Experience :

  • 5+ years of hands-on data engineering experience.
  • Strong working knowledge of the Azure ecosystem, especially :

  • Azure Databricks
  • Azure Data Lake Storage (ADLS)
  • Azure Functions of Azure Data Factory (optional but preferred)
  • Expertise in Apache Spark with Java (PySpark).
  • Advanced SQL skills including query optimization.
  • Strong understanding of ETL / ELT methodologies and data warehousing concepts.
  • Experience working with Delta Lake (schema evolution, ACID, time travel).
  • Experience with PostgreSQL or similar databases.
  • Strong problem-solving skills and attention to detail.
  • Ability to communicate effectively with technical and non-technical teams.
  • Proactive, self-driven, and able to work in fast-paced environments.
  • Preferred Skills :

  • Experience with CI / CD tools (Azure DevOps, Git).
  • Knowledge of infrastructure-as-code tools (Terraform).
  • Exposure to streaming platforms (Kafka, Event Hub).
  • Familiarity with data governance tools such as Purview.
  • Skills : Azure Cloud,Java,Pyspark

    MUST HAVE :

    Skills : Azure Cloud,Java,Pyspark

    Notice period - 0 to 15days only

    (ref : hirist.tech)

    Create a job alert for this search

    Data Engineering Lead • Pune

    Related jobs
    • Promoted
    Data Engineering Lead

    Data Engineering Lead

    Persistent SystemsPune, Maharashtra, India
    We are seeking Data Engineering Lead with hands scrum, product owner, etc.Location : All Persistent Locations.Job Type : Full Time Employment. Define and execute the product vision and roadmap for the...Show moreLast updated: 3 days ago
    • Promoted
    Project Manager – Data Engineering & Analytics

    Project Manager – Data Engineering & Analytics

    BrillioPune, IN
    We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show moreLast updated: 30+ days ago
    • Promoted
    Vice President, Data Engineering & Architecture

    Vice President, Data Engineering & Architecture

    Three AcrossPune, IN
    Role : - Vice President – Data Engineering & Architecture.We are seeking a hands-on and visionary leader to serve as Vice President – Data Engineering & Architecture. This role will drive digital tran...Show moreLast updated: 6 days ago
    • Promoted
    Offshore Delivery Lead

    Offshore Delivery Lead

    EXLPune, India
    Job Title : Offshore Delivery Lead Band – D1 / D2.Location : Pune, Gurgaon, Noida, Hyderabad, Bengaluru.We are looking for an experienced Delivery Lead to manage and deliver data management p...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineering Lead - BI Analytics & Data Warehouse

    Data Engineering Lead - BI Analytics & Data Warehouse

    Calfus Inc.Pune, Maharashtra, India
    About Us : At Calfus, we are known for delivering cutting-edge AI agents and products that transform businesses in ways previously unimaginable. We empower companies to harness the full potential of...Show moreLast updated: 5 days ago
    • Promoted
    BI Engineering Lead

    BI Engineering Lead

    Persistent SystemsPune, Maharashtra, India
    About Position : The BI Lead will be responsible for designing advanced Power BI dashboards, integrating data from Snowflake and SQL Server, and delivering insights through effective data visualiza...Show moreLast updated: 24 days ago
    Data Engineering Lead

    Data Engineering Lead

    AscenttPune, Mahārāshtra, India, 411014
    Ascentt is building cutting-edge data analytics & AI / ML solutions for global automotive and manufacturing leaders.We turn enterprise data into real-time decisions using advanced machine learning an...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager - Data Platform

    Engineering Manager - Data Platform

    CoinbasePune, IN
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Calfus Inc.pune, maharashtra, in
    As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven d...Show moreLast updated: 24 days ago
    • Promoted
    Reltio Lead / Architect

    Reltio Lead / Architect

    Mastech Digitalpune, maharashtra, in
    Chennai / Bangalore / Hyderabad / Noida / Remote with quarterly visit.LPA (Depending on level of expertise).Immediate joiner / Currently serving notice / Notice is less than 60 days.We are looking for a hands...Show moreLast updated: 27 days ago
    • Promoted
    Azure Data Lead / Architect

    Azure Data Lead / Architect

    TEKsystems Global Services in IndiaPune, IN
    Notice Period : Immediate to15 Days.Please find the below Azure Data Lead / Architect JD.Azure AI skills, Azure Open AI, AI Foundry. Excellent communication and interpersonal skills, with the ability t...Show moreLast updated: 7 days ago
    • Promoted
    Lead Data Engineer - Data Engineering

    Lead Data Engineer - Data Engineering

    ConfidentialPune
    The Lead Data Engineer (DE Lead) plays a pivotal role in managing and fulfilling structured data requests in alignment with organizational policies and regulatory standards.As the primary technical...Show moreLast updated: 10 days ago
    • Promoted
    Engineering Lead - Cloud & Data Engineering

    Engineering Lead - Cloud & Data Engineering

    Nazztec Private LimitedPune
    Job Title : Engineering Lead Cloud & Data Engineer Work Base Location : Chennai / Hyderabad / Pune Experience Ra...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager - II, Data Engineering Platform

    Engineering Manager - II, Data Engineering Platform

    TamaraPune, IN
    Data Engineering Manager II : Real-Time Data & Experimentation Platform (Remote, India).Saudi Arabia's first fintech unicorn. GCC, with a mission to empower dreams through customer-centric financial ...Show moreLast updated: 7 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analyticspune, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpresspune, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 7 days ago
    • Promoted
    Publicis Sapient - Data Engineering Manager / Architect

    Publicis Sapient - Data Engineering Manager / Architect

    Publicis SapientPune
    Manager Data Engineer As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing GCP / Azure ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incPune, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 30+ days ago