Talent.com
Databricks Lead
Databricks LeadMastech Digital • ajit, India
Databricks Lead

Databricks Lead

Mastech Digital • ajit, India
17 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • ajit, India

    Related jobs
    ETL Developer

    ETL Developer

    LogFix SCM Solutions Pvt Ltd • ajit, India
    Position : ETL Developer with API.We are looking for an experienced(6+) Informatica ETL Developer with strong skills in Oracle, API integration, and data modeling. The role involves designing and de...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    CXC • ajit, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • ajit, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 1 day ago • Promoted
    Cloud Architect

    Cloud Architect

    PwC India • ajit, India
    Define reference architectures for lakehouse and medallion patterns using Delta Lake, OneLake, and Synapse / Fabric Lakehouse for scalable analytics and AI. Create domain-driven data models, canonical...Show more
    Last updated: 5 hours ago • Promoted • New!
    Azure Data Engineer (BI Expertise)

    Azure Data Engineer (BI Expertise)

    Seosaph-infotech • ajit, India
    We are seeking a highly skilled.Business Intelligence (BI) expertise.The ideal candidate will have strong hands-on development skills, experience in. BI solution design, data modeling, and the abili...Show more
    Last updated: 23 hours ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Talentgigs • ajit, India
    Senior Data Engineer -GCP, SQL, Architect, Data Modeller.GCP, SQL, Architect, Data Modeller.Technical role 7+ Years Experience. Specific Contribution : We are looking for an experienced Senior Data E...Show more
    Last updated: 21 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    Impetus • ajit, India
    Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud...Show more
    Last updated: 17 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Sigmoid • ajit, India
    We are looking for a skilled TL Azure Data Engineer with 9+ years of experience in big data technologies, particularly Python, PYSpark, SQL and data lakehouse architectures.The ideal candidate will...Show more
    Last updated: 17 hours ago • Promoted • New!
    Senior Tableau Developer

    Senior Tableau Developer

    CYAN360 • ajit, India
    Role : Senior Tableau Developer.Work Timings : 4 : 30 PM to 12 : 30 AM IST.Need someone who can join immediately • • •.We are seeking a skilled Tableau Developer with hands-on experience in Databricks and / o...Show more
    Last updated: 23 hours ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • ajit, India
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 23 hours ago • Promoted
    MERN + React Native Developer

    MERN + React Native Developer

    Truxo • Patiala, Punjab, India
    FleetPulse is an innovative technology company focused on transforming the logistics and transportation industry through advanced Trucking Management Systems (TMS). We build scalable, high-performan...Show more
    Last updated: 27 days ago • Promoted
    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    The Datalytix Solutions • ajit, India
    The Datalytix Solutions is a modern data and analytics consulting company specializing in data engineering, BI, and cloud-based lakehouse architectures. We work with international clients across ind...Show more
    Last updated: 17 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • ajit, India
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MRF • ajit, India
    Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
    Last updated: 23 hours ago • Promoted
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • ajit, India
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 1 day ago • Promoted
    SaaS Platform Architect

    SaaS Platform Architect

    crenovent • ajit, India
    Crenovent is building a modern AI-driven data and automation platform for Revenue Organizations.This is a hands-on architecture role where you will help define how the platform is structured, how d...Show more
    Last updated: 17 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • ajit, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 23 hours ago • Promoted
    Senior Data Engineer - GCP

    Senior Data Engineer - GCP

    AuxoAI • ajit, India
    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal f...Show more
    Last updated: 17 hours ago • Promoted • New!