Talent.com
Databricks Lead
Databricks LeadMastech Digital • guwahati, India
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • guwahati, India
1 day ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • guwahati, India

    Related jobs
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • guwahati, assam, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 4 hours ago • Promoted • New!
    Technical Lead – Web Crawling Systems, Data Pipelines

    Technical Lead – Web Crawling Systems, Data Pipelines

    AIMLEAP • guwahati, assam, in
    Tech / MCA / Computer Science / IT.Industry : IT / Data / AI / E-commerce / FinTech / Healthcare.Proven experience leading data engineering teams with strong ownership of web crawling systems and pi...Show more
    Last updated: 4 hours ago • Promoted • New!
    Snowflake Lead / Architect

    Snowflake Lead / Architect

    Boolean Data Systems • guwahati, India
    Job Tittle : Snowflake Lead / Architect.Boolean Data Systems is a system integration company focusing on Snowflake products. We focus on helping companies implement innovative solutions combining Peopl...Show more
    Last updated: 11 days ago • Promoted
    Storage Admin L2 / L3

    Storage Admin L2 / L3

    Jio Platforms Limited (JPL) • Guwahati, Assam, India
    Experience : 5 - 15 Years of Experience in IBM / EMC or Other Storage products.Management of the storage solution including storage management policy, configuration and management of disk array, SAN ...Show more
    Last updated: 18 days ago • Promoted
    AWS Solution Architect

    AWS Solution Architect

    Saxon AI • guwahati, assam, in
    We are looking for a highly skilled.Architecture & System Modernization.Own the redesign of the Truscan backend architecture : . Multi-stage compute pipeline (Stage 1–4).High-performance Python worker...Show more
    Last updated: 4 hours ago • Promoted • New!
    Principal Data Engineer

    Principal Data Engineer

    Nexuspoint Consultant • guwahati, assam, in
    We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture,.You will work closely with cloud, security, and infrastructure architects to ensure seamless.Lead the ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    CXC • guwahati, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 2 days ago • Promoted
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • guwahati, India
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 2 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • guwahati, assam, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 22 days ago • Promoted
    Azure DevOps Data Engineer

    Azure DevOps Data Engineer

    Paritas Recruitment • guwahati, assam, in
    Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
    Last updated: 4 hours ago • Promoted • New!
    BPA Analyst

    BPA Analyst

    airtel • Guwahati, Assam, India
    Candidate will be part of circle Business Planning & Analysis team and will be primarily responsible for driving cost optimization projects across functions for efficiency build up and control gove...Show more
    Last updated: 19 days ago • Promoted
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    Techolution • guwahati, assam, in
    Remote
    The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST. If your expertise is primarily in.Lead the migration of large-scale SQL work...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    ShimentoX Technologies • guwahati, assam, in
    Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL. Must have proven background in building data connectors.Experience s...Show more
    Last updated: 4 hours ago • Promoted • New!
    Lead Database Administrator

    Lead Database Administrator

    Ironbook AI • guwahati, assam, in
    We are seeking an experienced Lead Database Administrator / Developer with deep expertise in.The ideal candidate will play a key role in modernizing our database infrastructure, leading large-scale m...Show more
    Last updated: 4 hours ago • Promoted • New!
    Amazon Redshift

    Amazon Redshift

    Vidhema Technologies • guwahati, India
    Notice Period : Immediate Joiners Preferred.We are looking for an experienced.Amazon Redshift Developer to lead the design, setup, and management of new Redshift projects from the ground up.The idea...Show more
    Last updated: 11 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • guwahati, assam, in
    Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    TerraGiG • guwahati, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 2 days ago • Promoted
    Lead Python Developer_ Exp : 8+ Years

    Lead Python Developer_ Exp : 8+ Years

    Atyeti Inc • guwahati, India
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show more
    Last updated: 1 day ago • Promoted