Talent.com
Databricks Lead
Databricks LeadMastech Digital • indore, madhya pradesh, in
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • indore, madhya pradesh, in
21 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • indore, madhya pradesh, in

    Related jobs
    SAP Project Lead

    SAP Project Lead

    HCLTech • Greater Lucknow Area, India
    Should have 7+ years of experience of handling support project in SAP as well Non-SAP Application.Should be well versed in ITIL processes and execute the same as per the contract.Should be able to ...Show more
    Last updated: 13 days ago • Promoted
    Data Architect

    Data Architect

    Tech Mahindra • indore, madhya pradesh, in
    We are seeking a highly skilled professional who can.ETL processes, and data quality initiatives.Having experience into any Cloud (Azure / GCP / AWS). Proposing solutions to optimize existing.Develo...Show more
    Last updated: 28 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Indore, Madhya Pradesh, India
    TCS is Hiring AWS Data Engineer For Indore location.Please apply only if you are available for a In-person interview at TCS Indore on 6th December 2025 (Saturday). AWS Snowflake, Python, Pyspark.Sup...Show more
    Last updated: 30+ days ago • Promoted
    Project Leader - IT

    Project Leader - IT

    Sequifi • Indore, Madhya Pradesh, India
    Position Title : Project Leader.HR Tech company focused on transforming workforce and talent operations through next-generation automation, intelligent workflows, and scalable digital solutions.Our ...Show more
    Last updated: 5 days ago • Promoted
    Tech Lead Full Stack-Contract

    Tech Lead Full Stack-Contract

    Gravity Infosolutions, Inc. • indore, madhya pradesh, in
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Architect

    Azure Data Architect

    9NEXUS • indore, madhya pradesh, in
    We are seeking an experienced Azure Data Architect to design, implement, and optimize enterprise-scale data platforms on Microsoft Azure. Design end-to-end Azure data architecture including ingestio...Show more
    Last updated: 22 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • indore, madhya pradesh, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 21 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Indore, Madhya Pradesh, India
    Senior associate with hands-on working experience with Azure tool (primarily ADF / Dataflow / Databricks), building data pipelines and CICD pipelines. Having experience to process data from on-prem / C...Show more
    Last updated: 28 days ago • Promoted
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • indore, madhya pradesh, in
    Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare . Experience working with cloud platforms such ...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CXC • indore, madhya pradesh, in
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • indore, India
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 6 hours ago • Promoted • New!
    Python & NLP Lead Engineer- WFH

    Python & NLP Lead Engineer- WFH

    AgileEngine • Indore, Madhya Pradesh, India
    THIS IS FULLY REMOTE WORKING OPPORTUNITY.We someone who can join in less than 15 days.Pls read the JD carefully and only proceed if you have the relevant experience. If you are interested and fulfil...Show more
    Last updated: 10 days ago • Promoted
    Backend AI / ML Engineer (with Full Stack Expertise)

    Backend AI / ML Engineer (with Full Stack Expertise)

    TalentLynk • Indore, Madhya Pradesh, India
    Position : Backend AI / ML Engineer (with Full Stack Expertise).This role transcends traditional backend development.We’re seeking a highly skilled Backend AI / ML Engineer with strong Python expertise ...Show more
    Last updated: 13 days ago • Promoted
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • indore, madhya pradesh, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 3 days ago • Promoted
    AI Lead Engineer ( Python & NLP )- WFH

    AI Lead Engineer ( Python & NLP )- WFH

    AgileEngine • Indore, Madhya Pradesh, India
    THIS IS FULLY REMOTE WORKING OPPORTUNITY.We someone who can join in less than 15 days.Pls read the JD carefully and only proceed if you have the relevant experience. If you are interested and fulfil...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • indore, madhya pradesh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • indore, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 12 hours ago • Promoted • New!
    LSE / Associate Architect - Big Data

    LSE / Associate Architect - Big Data

    Impetus • Indore, Madhya Pradesh, India
    Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions. In-depth understanding of Big data concepts and distribut...Show more
    Last updated: 30+ days ago • Promoted