Talent.com
Databricks Lead
Databricks LeadMastech Digital • vizianagaram, andhra pradesh, in
Databricks Lead

Databricks Lead

Mastech Digital • vizianagaram, andhra pradesh, in
9 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • vizianagaram, andhra pradesh, in

    Related jobs
    Cloud Architect

    Cloud Architect

    PwC India • vizianagaram, andhra pradesh, in
    Define reference architectures for lakehouse and medallion patterns using Delta Lake, OneLake, and Synapse / Fabric Lakehouse for scalable analytics and AI. Create domain-driven data models, canonical...Show more
    Last updated: 9 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    Impetus • vizianagaram, andhra pradesh, in
    Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Governance Application Architect

    Data Governance Application Architect

    Vista Applied Solutions Group Inc • vizianagaram, andhra pradesh, in
    This is a technical role with a strong business acumen requirement; hence it is expected the Integration Architect continuously invests in learning and stays on par with the latest in Data Governan...Show more
    Last updated: 18 days ago • Promoted
    Lead Python Developer

    Lead Python Developer

    Luxoft India • vizianagaram, andhra pradesh, in
    We have an ambitious goal to migrate a legacy system written in HLASM (High-Level Assembler) from the mainframe to a cloud-based Java environment for one of the largest banks in the USA.We are look...Show more
    Last updated: 9 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Dr. Martens plc • vizianagaram, andhra pradesh, in
    Working within a multi-disciplined team led by the.Senior Manager - Data Engineer.This is an exciting opportunity to contribute to a dynamic and innovative environment, where your work will directl...Show more
    Last updated: 9 hours ago • Promoted • New!
    Lead Full-Stack + AI Engineer (Founding Team)

    Lead Full-Stack + AI Engineer (Founding Team)

    Grovio AI • vizianagaram, andhra pradesh, in
    We’re building an autonomous, multi-agent AI OS that plans, executes, and optimizes marketing across modern digital ecosystems. Think : an AI that acts like a virtual CMO — planning, writing, analyz...Show more
    Last updated: 3 days ago • Promoted
    Technical Lead

    Technical Lead

    RapidBrains • vizianagaram, andhra pradesh, in
    We are looking for an experienced Technical Lead who can architect scalable systems, mentor development teams, and guide complex projects from concept to deployment. You’ll partner closely with Prod...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • vizianagaram, andhra pradesh, in
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 9 hours ago • Promoted • New!
    Databricks Architect

    Databricks Architect

    Mastech Digital • vizianagaram, andhra pradesh, in
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.You will drive technical strategy, define Lakehouse architecture standards, and guide engineering teams in buildi...Show more
    Last updated: 9 hours ago • Promoted • New!
    Aws Databricks Engineer

    Aws Databricks Engineer

    People Prime Worldwide • vizianagaram, andhra pradesh, in
    Experience : 5–12 Years (STRICTLY).Notice Period : Immediate Joiners.Our client is a global leader in digital transformation and IT services across 50+ countries. They specialize in cloud modernizatio...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    AS Technology Corporation • vizianagaram, andhra pradesh, in
    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data framew...Show more
    Last updated: 30+ days ago • Promoted
    Lead GCP Dataengineer

    Lead GCP Dataengineer

    People Prime Worldwide • vizianagaram, andhra pradesh, in
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Tableau Developer

    Senior Tableau Developer

    CYAN360 • vizianagaram, andhra pradesh, in
    Role : Senior Tableau Developer.Work Timings : 4 : 30 PM to 12 : 30 AM IST.Need someone who can join immediately • • •.We are seeking a skilled Tableau Developer with hands-on experience in Databricks and / o...Show more
    Last updated: 9 hours ago • Promoted • New!
    Lead Data Engineer with AWS

    Lead Data Engineer with AWS

    People Prime Worldwide • vizianagaram, andhra pradesh, in
    Senior Data Engineer- (Python & AWS (Simplified JD).We are looking for a Senior Data Engineer who can build, maintain, and optimize large-scale data systems using. You will design data pipelines, en...Show more
    Last updated: 9 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • vizianagaram, andhra pradesh, in
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • vizianagaram, andhra pradesh, in
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 9 hours ago • Promoted • New!
    ETL Developer

    ETL Developer

    LogFix SCM Solutions Pvt Ltd • vizianagaram, andhra pradesh, in
    Position : ETL Developer with API.We are looking for an experienced(6+) Informatica ETL Developer with strong skills in Oracle, API integration, and data modeling. The role involves designing and de...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    The Datalytix Solutions • vizianagaram, andhra pradesh, in
    The Datalytix Solutions is a modern data and analytics consulting company specializing in data engineering, BI, and cloud-based lakehouse architectures. We work with international clients across ind...Show more
    Last updated: 9 hours ago • Promoted • New!