Talent.com
Databricks Lead
Databricks LeadMastech Digital • bhopal, madhya pradesh, in
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • bhopal, madhya pradesh, in
19 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • bhopal, madhya pradesh, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • bhopal, madhya pradesh, in
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Tech Lead Full Stack-Contract

    Tech Lead Full Stack-Contract

    Gravity Infosolutions, Inc. • bhopal, madhya pradesh, in
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • bhopal, madhya pradesh, in
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • bhopal, madhya pradesh, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 21 days ago • Promoted
    Lead Consultant-Digital services- Backend (.net with Sharepoint)-Bhopal / Vadodara

    Lead Consultant-Digital services- Backend (.net with Sharepoint)-Bhopal / Vadodara

    BDO India • Bhopal, Madhya Pradesh, India
    BDO is a global network of professional services firms with a presence in over 166 countries, revenue of over USD 14 billion, and experience of over 60 years. It’s a leading service provider for the...Show more
    Last updated: 1 day ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • bhopal, India
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • bhopal, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Tableau Developer

    Senior Tableau Developer

    CYAN360 • bhopal, India
    Role : Senior Tableau Developer.Work Timings : 4 : 30 PM to 12 : 30 AM IST.Need someone who can join immediately • • •.We are seeking a skilled Tableau Developer with hands-on experience in Databricks and / o...Show more
    Last updated: 10 hours ago • Promoted • New!
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • bhopal, madhya pradesh, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 3 days ago • Promoted
    Data Architect

    Data Architect

    Tech Mahindra • bhopal, madhya pradesh, in
    We are seeking a highly skilled professional who can.ETL processes, and data quality initiatives.Having experience into any Cloud (Azure / GCP / AWS). Proposing solutions to optimize existing.Develo...Show more
    Last updated: 28 days ago • Promoted
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • bhopal, madhya pradesh, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 26 days ago • Promoted
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • bhopal, madhya pradesh, in
    Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare . Experience working with cloud platforms such ...Show more
    Last updated: 3 days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • bhopal, madhya pradesh, in
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 19 hours ago • Promoted • New!
    Sr PTC FlexPLM Developer / Lead

    Sr PTC FlexPLM Developer / Lead

    KMM Technologies, Inc. • bhopal, madhya pradesh, in
    Position Name : Sr PTC FlexPLM Developer / Lead.Work Hours : M-F Working Hours : 9am EST to 2pm US EST.There is an urgent resource need with PTC FlexPLM software implementation experience.Senior Develop...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Architect

    Azure Data Architect

    9NEXUS • bhopal, madhya pradesh, in
    We are seeking an experienced Azure Data Architect to design, implement, and optimize enterprise-scale data platforms on Microsoft Azure. Design end-to-end Azure data architecture including ingestio...Show more
    Last updated: 19 hours ago • Promoted • New!
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • bhopal, madhya pradesh, in
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 1 day ago • Promoted
    Senior Developer - ODI

    Senior Developer - ODI

    KPI Partners • bhopal, madhya pradesh, in
    Mandatory Skill : ODI, OBIEE, DWH, Python Programming, SQL.Design and develop ETL processes using Oracle Data Integrator to facilitate seamless data integration between various sources and targets....Show more
    Last updated: 28 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • bhopal, madhya pradesh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted