Talent.com
Databricks Lead
Databricks LeadMastech Digital • narela, India
Databricks Lead

Databricks Lead

Mastech Digital • narela, India
14 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • narela, India

    Related jobs
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • narela, delhi, in
    Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • narela, delhi, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Scientist + Instructor - AI&ML

    Lead Data Scientist + Instructor - AI&ML

    Newton School of Technology • Sonipat, Haryana, India
    Newton School of Technology (NST) is a new-age institution redefining technical education in India.Founded by IIT alumni, NST offers a 4-year B. Tech in Computer Science and AI, focused on hands-on ...Show more
    Last updated: 28 days ago • Promoted
    Lead Data Scientist

    Lead Data Scientist

    Inshorts • Narela, Delhi, India
    Inshorts is looking for a talented Data Scientist with a strong background in computer science and statistics to join our team and help us make data-driven decisions. You’ll analyze large datase...Show more
    Last updated: 4 days ago • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digital • narela, delhi, in
    Responsible for designing and building backend system.Focus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences. Acts as a strong individual c...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Architect

    Lead Data Architect

    People Equation • Narela, Delhi, India
    Job Description : Data Platform Architect Location : Delhi, NCR (WFO) Experience : 12 -15 years.Educational Qualifications Bachelor’s or Master’s degree in Computer Science, Information Systems, o...Show more
    Last updated: 19 hours ago • Promoted • New!
    Data Science Team Lead

    Data Science Team Lead

    Inshorts • Narela, Delhi, India
    Inshorts is looking for a talented Data Scientist with a strong background in computer science and statistics to join our team and help us make data-driven decisions. You’ll analyze large datase...Show more
    Last updated: 12 hours ago • Promoted • New!
    Lead Backend Developer+Instructor

    Lead Backend Developer+Instructor

    Newton School of Technology • Sonipat, Haryana, India
    SDE 2 / 3 + Instructor – Backend Engineering and System design.About Newton School of Technology (NST) : .Newton School of Technology (NST), founded by IIT alumni, offers a hands-on B.Tech in Computer ...Show more
    Last updated: 21 days ago • Promoted
    Senior Full Stack Developer

    Senior Full Stack Developer

    NUKG Business Solutions • narela, delhi, in
    Business, Process & Technology consulting company with niche expertise in the area of US Benefits Administration and Data Management. NUKG's headquarters are based in NJ, USA and the Global Delivery...Show more
    Last updated: 4 hours ago • Promoted • New!
    Backend / Fullstack Engineer (PHP • Drupal • Python)

    Backend / Fullstack Engineer (PHP • Drupal • Python)

    Pulp Strategy • narela, delhi, in
    Pulp Strategy develops robust platforms, CMS ecosystems, and automated backend systems powering enterprise-level performance. With a focus on productized workflows and digital acceleration, we are s...Show more
    Last updated: 3 hours ago • Promoted • New!
    Lead Data Scientist + Instructor - Ai&Ml

    Lead Data Scientist + Instructor - Ai&Ml

    Newton School of Technology • Sonīpat, Republic Of India, IN
    Newton School of Technology (NST) is a new-age institution redefining technical education in India.Founded by IIT alumni, NST offers a 4-year B. Tech in Computer Science and AI, focused on hands-on ...Show more
    Last updated: 28 days ago • Promoted
    Sentinel Engineer

    Sentinel Engineer

    OpalSoft • Narela, Delhi, India
    We’re seeking a Microsoft Sentinel Implementation Engineer to design, deploy, and optimize Microsoft Sentinel and Defender-based SOC environments. This role supports SOC operations by enabling effic...Show more
    Last updated: 26 days ago • Promoted
    Generative AI & Data Orchestration Lead

    Generative AI & Data Orchestration Lead

    Vichara Technologies • Narela, Delhi, India
    We are seeking a highly skilled GenAI Lead Engineer to design and implement advanced frameworks for alternate data analysis in the investment management domain. The candidate will leverage LLM...Show more
    Last updated: 19 hours ago • Promoted • New!
    Manager – Quick Commerce & E-commerce

    Manager – Quick Commerce & E-commerce

    Rama vision limited • Narela, Delhi, India
    Job Description : Manager – Quick Commerce Location : Delhi Department : E-Commerce / Quick Commerce Experience Required : Mandatory prior experience in Quick Commerce (Blinkit, Swiggy Instamart, Ze...Show more
    Last updated: 4 days ago • Promoted
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • narela, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Tableau Developer

    Senior Tableau Developer

    CYAN360 • narela, India
    Role : Senior Tableau Developer.Work Timings : 4 : 30 PM to 12 : 30 AM IST.Need someone who can join immediately • • •.We are seeking a skilled Tableau Developer with hands-on experience in Databricks and / o...Show more
    Last updated: 22 hours ago • Promoted • New!
    Cloud Architect

    Cloud Architect

    PwC India • narela, India
    Define reference architectures for lakehouse and medallion patterns using Delta Lake, OneLake, and Synapse / Fabric Lakehouse for scalable analytics and AI. Create domain-driven data models, canonical...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer + Instructor

    Data Engineer + Instructor

    Newton School of Technology • Sonipat, Haryana, India
    We are looking for a passionate and experienced.AI concepts, with a strong emphasis on Python programming.You will guide learners in building skills to visualize, analyze, and model data, preparing...Show more
    Last updated: 28 days ago • Promoted