Talent.com
Databricks Lead
Databricks LeadMastech Digital • vapi, India
Databricks Lead

Databricks Lead

Mastech Digital • vapi, India
14 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • vapi, India

    Related jobs
    IPR Lead

    IPR Lead

    STL - Sterlite Technologies Limited • Silvassa, Daman and Diu, India
    We are seeking a passionate intellectual property professional eager to learn and grow in a fastpaced, and cutting-edge technology environment. In this role, you will have the chance to refine and a...Show more
    Last updated: 6 days ago • Promoted
    Technology Engineer

    Technology Engineer

    STL - Sterlite Technologies Limited • Silvassa, Daman and Diu, India
    We are hiring for a Technology Engineer for STL with a minimum 2 years of experience post B.Candidate should work as the project leader for the NPD in the Copper LAN Cable function.Understanding of...Show more
    Last updated: 11 days ago • Promoted
    Research Development Design Engineer - Radiology

    Research Development Design Engineer - Radiology

    Meril • Vapi, Gujarat, India
    R&D Design Engineer – Radiology & Imaging Systems.R&D Design – Radiology Division.Manager / Senior Manager – R&D Design.X-Ray, C-Arm, Digital Radiography (DR), CT systems, and related accessories.X...Show more
    Last updated: 28 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • vapi, India
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 3 hours ago • Promoted • New!
    Applied AI Engineer

    Applied AI Engineer

    Meril • Vapi, Gujarat, India
    Applied AI Engineer – Fresher (IIT / NIT Graduates Only).We are seeking high-potential graduates from.This opportunity is ideal for someone with a solid foundation in. AI, machine learning, and deep l...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Talentgigs • vapi, India
    Senior Data Engineer -GCP, SQL, Architect, Data Modeller.GCP, SQL, Architect, Data Modeller.Technical role 7+ Years Experience. Specific Contribution : We are looking for an experienced Senior Data E...Show more
    Last updated: 19 hours ago • Promoted • New!
    RL Research Engineer

    RL Research Engineer

    Meril • Vapi, Gujarat, India
    RL Research Engineer (Planning & Control).We are seeking a highly skilled.Reinforcement Learning (RL) Research Engineer.The role focuses on designing learning-based planners and policies (RL, imita...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • vapi, India
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 21 hours ago • Promoted • New!
    Senior Data Scientist - NLP

    Senior Data Scientist - NLP

    Meril • Vapi, Gujarat, India
    We’re Hiring : Senior Data Scientist – NLP.Years in Data Science / ML Engineering (.Minimum 3 years tenure in most recent organization in a relevant data science / ML role). Senior-level data scientist r...Show more
    Last updated: 18 days ago • Promoted
    Senior Tableau Developer

    Senior Tableau Developer

    CYAN360 • vapi, India
    Role : Senior Tableau Developer.Work Timings : 4 : 30 PM to 12 : 30 AM IST.Need someone who can join immediately • • •.We are seeking a skilled Tableau Developer with hands-on experience in Databricks and / o...Show more
    Last updated: 21 hours ago • Promoted • New!
    Azure Data Engineer (BI Expertise)

    Azure Data Engineer (BI Expertise)

    Seosaph-infotech • vapi, India
    We are seeking a highly skilled.Business Intelligence (BI) expertise.The ideal candidate will have strong hands-on development skills, experience in. BI solution design, data modeling, and the abili...Show more
    Last updated: 21 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Meril • Vapi, Gujarat, India
    Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You’ll work with diverse data types and modern data platforms to desi...Show more
    Last updated: 26 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Meril • Vapi, Gujarat, India
    AI / ML Engineer (Fresher / 0–1 Year Experience).We are looking for passionate AI / ML Engineers from a Computer Engineering background to work on cutting-edge AI-driven drug discovery and advanced r...Show more
    Last updated: 11 days ago • Promoted
    SLAM Expert Application

    SLAM Expert Application

    Meril • Vapi, Gujarat, India
    LiDAR, and multi-sensor fusion, as well as dense and semantic mapping.The role involves developing robust SLAM systems for various robotics platforms. Architect multi-modal SLAM systems (VIO / LIO / VLI...Show more
    Last updated: 30+ days ago • Promoted
    Area Head (Center Manager)

    Area Head (Center Manager)

    Dr Reddy's Foundation • Silvassa, Daman and Diu, India
    Reddy’s Foundation (DRF) is a not-for-profit organization, focused on enhancing the dignity and well-being of socially and economically vulnerable people. We empower communities through improved edu...Show more
    Last updated: 30+ days ago • Promoted
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • vapi, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 21 hours ago • Promoted • New!
    Cloud Architect

    Cloud Architect

    PwC India • vapi, India
    Define reference architectures for lakehouse and medallion patterns using Delta Lake, OneLake, and Synapse / Fabric Lakehouse for scalable analytics and AI. Create domain-driven data models, canonical...Show more
    Last updated: 3 hours ago • Promoted • New!
    Simulation Engineer

    Simulation Engineer

    Meril • Vapi, Gujarat, India
    Job Title : Simulation Expert (Sim / Middleware).We are seeking an experienced • •Simulation Expert (Sim / Middleware) • • to own photorealistic and physics-accurate simulation, scenario generation, and CI...Show more
    Last updated: 30+ days ago • Promoted