Talent.com
Databricks Lead
Databricks LeadMastech Digital • narela, India
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • narela, India
16 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • narela, India

    Related jobs
    Part-Time Data Analyst (Power BI + SQL + Google Sheets)

    Part-Time Data Analyst (Power BI + SQL + Google Sheets)

    StrategyCFO • narela, India
    Part-Time Data Analyst & Power BI Developer (with Data Engineering Skills).Engagement : Part-Time (15–25 hours / week to start). Compensation : Competitive, based on skill and experience.StrategyCFO is ...Show more
    Last updated: 23 hours ago • Promoted
    Lead Data Scientist + Instructor - AI&ML

    Lead Data Scientist + Instructor - AI&ML

    Newton School of Technology • Sonipat, Haryana, India
    Newton School of Technology (NST) is a new-age institution redefining technical education in India.Founded by IIT alumni, NST offers a 4-year B. Tech in Computer Science and AI, focused on hands-on ...Show more
    Last updated: 28 days ago • Promoted
    Amazon Redshift

    Amazon Redshift

    Vidhema Technologies • narela, India
    Notice Period : Immediate Joiners Preferred.We are looking for an experienced.Amazon Redshift Developer to lead the design, setup, and management of new Redshift projects from the ground up.The idea...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Lead Python Developer_ Exp : 8+ Years

    Lead Python Developer_ Exp : 8+ Years

    Atyeti Inc • narela, India
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show more
    Last updated: 23 hours ago • Promoted
    CCH Tagetik (Immediate joiner)

    CCH Tagetik (Immediate joiner)

    ANP Consulting • narela, India
    PAN India (Hybrid / Work from home).ANP Consulting is looking for an experienced Tagetik Professional to join our growing team. The ideal candidate should understand CCH Tagetik’s EPM, FPM and CPM so...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Lead Data Scientist

    Lead Data Scientist

    Inshorts • Narela, Delhi, India
    Inshorts is looking for a talented Data Scientist with a strong background in computer science and statistics to join our team and help us make data-driven decisions. You’ll analyze large datase...Show more
    Last updated: 4 days ago • Promoted
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • narela, India
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 1 day ago • Promoted
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • narela, India
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 23 hours ago • Promoted
    Lead Data Architect

    Lead Data Architect

    People Equation • Narela, Delhi, India
    Job Description : Data Platform Architect Location : Delhi, NCR (WFO) Experience : 12 -15 years.Educational Qualifications Bachelor’s or Master’s degree in Computer Science, Information Systems, o...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Science Team Lead

    Data Science Team Lead

    Inshorts • Narela, Delhi, India
    Inshorts is looking for a talented Data Scientist with a strong background in computer science and statistics to join our team and help us make data-driven decisions. You’ll analyze large datase...Show more
    Last updated: 13 hours ago • Promoted • New!
    Healthcare Analytics Consultant

    Healthcare Analytics Consultant

    Tiger Analytics • Narela, Delhi, India
    As a Data Analyst – Healthcare Analytics , you will be responsible for driving the architecture, delivery, and governance of Azure-based data solutions across multiple programs You will play a ...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Management Architect

    Data Management Architect

    Jio Platforms Limited (JPL) • Narela, Delhi, India
    We are looking for Solution Architects for designing data management solutions, having strong knowledge of architecting and designing highly available and scalable database on cloud - He will deliv...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • narela, India
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer + Instructor

    Data Engineer + Instructor

    Newton School of Technology • Sonipat, Haryana, India
    We are looking for a passionate and experienced.AI concepts, with a strong emphasis on Python programming.You will guide learners in building skills to visualize, analyze, and model data, preparing...Show more
    Last updated: 27 days ago • Promoted
    Generative AI & Data Orchestration Lead

    Generative AI & Data Orchestration Lead

    Vichara Technologies • Narela, Delhi, India
    We are seeking a highly skilled GenAI Lead Engineer to design and implement advanced frameworks for alternate data analysis in the investment management domain. The candidate will leverage LLM...Show more
    Last updated: 20 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    TerraGiG • narela, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 1 day ago • Promoted
    Healthcare Data Insights Analyst

    Healthcare Data Insights Analyst

    Tiger Analytics • Narela, Delhi, India
    As a Data Analyst – Healthcare Analytics , you will be responsible for driving the architecture, delivery, and governance of Azure-based data solutions across multiple programs You will play a ...Show more
    Last updated: 20 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    CXC • narela, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted