Talent.com
Databricks Lead
Databricks LeadMastech Digital • ajit, India
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • ajit, India
23 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • ajit, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • ajit, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • ajit, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 2 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • ajit, India
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 1 day ago • Promoted
    Python Developer (AWS & Infrastructure)

    Python Developer (AWS & Infrastructure)

    Yoda Tech • ajit, India
    Python Developer (With AWS & Infrastructure experience).We are looking for a Python Developer with strong experience in designing and implementing scalable, secure applications in complex cloud env...Show more
    Last updated: 1 day ago • Promoted
    Power Pages Developer

    Power Pages Developer

    PLEXO HR Solutions • ajit, India
    Information Technology & Services.We are seeking a Power Pages Developer to design, build, and extend secure, scalable external- facing digital applications using Power Pages and Microsoft Datavers...Show more
    Last updated: 2 days ago • Promoted
    SAP Sustainability Consultant

    SAP Sustainability Consultant

    Cozzera • ajit, India
    SAP Sustainability Consultant (Sustainability Control Tower).We are seeking SAP Consultants with hands-on experience in implementing the. SAP Sustainability Control Tower (SCT).ESG reporting, and re...Show more
    Last updated: 1 day ago • Promoted
    Lead – Robotics & STEM Curriculum

    Lead – Robotics & STEM Curriculum

    Evobi Automations Pvt Ltd • ajit, India
    Bengaluru, brings over 12 years of expertise in technology and manufacturing.This is a full-time on-site role for a Robotics Curriculum Lead ( in Yudu Robotics Division ) based at our Bengaluru of...Show more
    Last updated: 5 hours ago • Promoted • New!
    SAP CPI Developer (ECP and Successfactors)

    SAP CPI Developer (ECP and Successfactors)

    Insight Global • ajit, India
    We are seeking an experienced SAP Integration Developer with a strong focus on SAP Integration Suite (CPI) and.SAP SuccessFactors, particularly Employee Central and Employee Central Payroll (ECP) i...Show more
    Last updated: 1 day ago • Promoted
    Distributed Database – Sales Engineer (Pre-Sales | Distributed Systems Specialist)

    Distributed Database – Sales Engineer (Pre-Sales | Distributed Systems Specialist)

    CareerXperts Consulting • ajit, India
    This role blends deep technical expertise with customer engagement, solution prototyping, and architecture advisory.Engage with prospective customers to understand business drivers, technical chall...Show more
    Last updated: 1 day ago • Promoted
    Amazon Redshift

    Amazon Redshift

    Vidhema Technologies • ajit, India
    Notice Period : Immediate Joiners Preferred.We are looking for an experienced.Amazon Redshift Developer to lead the design, setup, and management of new Redshift projects from the ground up.The idea...Show more
    Last updated: 5 hours ago • Promoted • New!
    Part-Time Data Analyst (Power BI + SQL + Google Sheets)

    Part-Time Data Analyst (Power BI + SQL + Google Sheets)

    StrategyCFO • ajit, India
    Part-Time Data Analyst & Power BI Developer (with Data Engineering Skills).Engagement : Part-Time (15–25 hours / week to start). Compensation : Competitive, based on skill and experience.StrategyCFO is ...Show more
    Last updated: 1 day ago • Promoted
    Senior Developer - ODI

    Senior Developer - ODI

    KPI Partners • ajit, India
    Mandatory Skill : ODI, OBIEE, DWH, Python Programming, SQL.Design and develop ETL processes using Oracle Data Integrator to facilitate seamless data integration between various sources and targets....Show more
    Last updated: 26 days ago • Promoted
    Full Stack Tech Lead- Contract

    Full Stack Tech Lead- Contract

    Gravity Infosolutions, Inc. • ajit, India
    Job description for Tech Lead Full Stack : .Conducts code review, contributes writing code, proficient in Java + at least one language between Typescript and Python. Basic understanding of Infrastruct...Show more
    Last updated: 2 days ago • Promoted
    CCH Tagetik (Immediate joiner)

    CCH Tagetik (Immediate joiner)

    ANP Consulting • ajit, India
    PAN India (Hybrid / Work from home).ANP Consulting is looking for an experienced Tagetik Professional to join our growing team. The ideal candidate should understand CCH Tagetik’s EPM, FPM and CPM so...Show more
    Last updated: 5 hours ago • Promoted • New!
    Oracle Analytics & AI Solutions Architect

    Oracle Analytics & AI Solutions Architect

    TribolaTech Inc • ajit, India
    Oracle Analytics & AI Solutions Architect.Candidates with strong Oracle Analytics & Cloud experience and 1–2 years in AI / LLM integration are encouraged. Full 10–15 years in AI is not expected.Analyt...Show more
    Last updated: 17 days ago • Promoted
    Senior SailPoint Developer_ Exp : 6+ to 10 Years

    Senior SailPoint Developer_ Exp : 6+ to 10 Years

    Atyeti Inc • ajit, India
    Job Description : Bachelor’s or master’s degree in computer science or equivalent.Experience developing in any programming stacks not limited to SQL, Python, PowerShell, JavaScript, Shell Scripting, ...Show more
    Last updated: 1 day ago • Promoted
    Lead Python Developer_ Exp : 8+ Years

    Lead Python Developer_ Exp : 8+ Years

    Atyeti Inc • ajit, India
    Strong hands-on experience in Python.Strong experience on Django / Flask framework development.Solid understanding of OOP, REST APIs, and microservices architecture. Exposure to SQL / NoSQL databases f...Show more
    Last updated: 1 day ago • Promoted
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • ajit, India
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 1 day ago • Promoted