Talent.com
Databricks Lead
Databricks LeadMastech Digital • Pune, IN
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • Pune, IN
18 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • Pune, IN

    Related jobs
    Azure databricks

    Azure databricks

    LTIMindtree • Pune, IN
    Show more
    Last updated: 5 days ago • Promoted
    Data Integration Developer (Level 2)

    Data Integration Developer (Level 2)

    Blutic • Pune, IN
    Data Integration Developer (Level 2).ETL processes, reports, and database solutions using.This role requires solid technical skills to implement solutions, optimize code, and collaborate effectivel...Show more
    Last updated: 28 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 13 days ago • Promoted
    Oracle ETL (ODI / OIC) Systems Analyst

    Oracle ETL (ODI / OIC) Systems Analyst

    Digile • Pune, IN
    We’re Hiring : Oracle ETL (ODI / OIC) Systems Analyst – Lead Role (8+ Years).This is a high-ownership role covering the full delivery lifecycle — from assessment and design to build, testing, deployme...Show more
    Last updated: 14 days ago • Promoted
    Solutions Manager – Tech Data Lead

    Solutions Manager – Tech Data Lead

    Entytle • Pune, Maharashtra, India
    Solutions Manager – Tech Data Lead.Entytle is on a mission to transform the Aftermarket for industrial OEMs using .AI-driven Installed Base Intelligence. Our platform helps the world’s leading equip...Show more
    Last updated: 18 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Pune, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 13 days ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • Pune, Maharashtra, India
    Job Title : Databricks Lead Location : Chennai / Hyderabad / Bangalore Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects Budget : Open to ...Show more
    Last updated: 8 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    Mphasis • Pune, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 12 days ago • Promoted
    Technical Lead – Data Platforms

    Technical Lead – Data Platforms

    Zywave • Pune, Maharashtra, India
    Position : Technical Lead – Data Engineering (Snowflake, SQL Server, Data Architecture) Location : Kharadi, Pune (Work from Office – 5 Days a Week) Shift Timing : 12 PM – 9 PM IST Experience : 8 to...Show more
    Last updated: 19 days ago • Promoted
    Data Solutions Director

    Data Solutions Director

    Amethyst Partners • Pune, IN
    This role carries both strategic and operational leadership responsibilities, managing Principal Analysts across APAC and working closely with data engineering, development, and global teams.You wi...Show more
    Last updated: 11 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Pune, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 18 days ago • Promoted
    Azure Data Architect

    Azure Data Architect

    9NEXUS • Pune, IN
    We are seeking an experienced Azure Data Architect to design, implement, and optimize enterprise-scale data platforms on Microsoft Azure. Design end-to-end Azure data architecture including ingestio...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    Blutic • Pune, IN
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show more
    Last updated: 18 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Pune, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Pune, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 13 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Pune, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 6 days ago • Promoted
    Solutions manager – tech data lead

    Solutions manager – tech data lead

    Entytle • Pune, Maharashtra, India
    Solutions Manager – Tech Data Lead Location : Pune / Hybrid Travel : About Entytle Entytle is on a mission to transform the Aftermarket for industrial OEMs using AI-driven Installed Base Intelligence...Show more
    Last updated: 8 hours ago • Promoted • New!