Talent.com
Databricks Lead
Databricks LeadMastech Digital • Pune, IN
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • Pune, IN
22 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • Pune, IN

    Related jobs
    Azure databricks

    Azure databricks

    LTIMindtree • Pune, IN
    Show more
    Last updated: 5 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 13 days ago • Promoted
    Solutions Manager – Tech Data Lead

    Solutions Manager – Tech Data Lead

    Entytle • Pune, Maharashtra, India
    Solutions Manager – Tech Data Lead.Entytle is on a mission to transform the Aftermarket for industrial OEMs using .AI-driven Installed Base Intelligence. Our platform helps the world’s leading equip...Show more
    Last updated: 18 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 15 days ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Pune, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 12 days ago • Promoted
    Data Solutions Director

    Data Solutions Director

    Amethyst Partners • Pune, IN
    This role carries both strategic and operational leadership responsibilities, managing Principal Analysts across APAC and working closely with data engineering, development, and global teams.You wi...Show more
    Last updated: 12 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Pune, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 18 days ago • Promoted
    Senior Data Architect

    Senior Data Architect

    Tata Consultancy Services • Pune, Maharashtra, India
    TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hi...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Architect

    Lead Data Architect

    Bajaj Technology Services • Pune, Maharashtra, India
    Build strong technical relationships with customer technology SMEs, actively engaging in the co-creation of innovative solutions in areas such as Modern Data Technologies like Spark, KAFKA, NoSQL D...Show more
    Last updated: 6 days ago • Promoted
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    Blutic • Pune, IN
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show more
    Last updated: 18 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Pune, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 13 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Tata Consultancy Services • Pune, Maharashtra, India
    Job title : Azure Data Engineer.Job Location : Kolkata, Pune, Bangalore, New Delhi.Virtual Interview : 28th Nov (Friday). Build the solution for optimal extraction, transformation, and loading of data...Show more
    Last updated: 7 days ago • Promoted
    Technical Lead – Data Platforms

    Technical Lead – Data Platforms

    Zywave • Pune, Maharashtra, India
    Technical Lead – Data Engineering (Snowflake, SQL Server, Data Architecture).Kharadi, Pune (Work from Office – 5 Days a Week). Medallion Architecture, Data Mesh) to lead the design and implementatio...Show more
    Last updated: 18 days ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • pune, India
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Pune, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 14 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Pune, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReady • Pune, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show more
    Last updated: 12 days ago • Promoted