Talent.com
Databricks Lead
Databricks LeadMastech Digital • Avadi, Thiruvallur (district), India
Databricks Lead

Databricks Lead

Mastech Digital • Avadi, Thiruvallur (district), India
5 hours ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • Avadi, Thiruvallur (district), India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    LTIMindtree • Avadi, Thiruvallur (district), India
    LTIMindtree is hiring for below positions and conducting only F2F-Inperson Drive in Chennai / Kolkata locations on 08th-Nov-2025(Saturday). Open Positions for Chennai / Kolkata based-(5+ to 12 Years onl...Show more
    Last updated: 30+ days ago • Promoted
    Senior Dbt (Data Build Tool) Engineer

    Senior Dbt (Data Build Tool) Engineer

    Ascendion • Avadi, Thiruvallur (district), India
    Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
    Last updated: 15 hours ago • Promoted • New!
    L2 Support Azure / Databricks

    L2 Support Azure / Databricks

    Randstad Digital • Ambattur, Thiruvallur (district), India
    Job Role : L2 Support Azure / Databricks.Functioning as an Application Support for the new Cloud platform at one of the corporate investment bank. Support the applications hosted on Azure / Databricks an...Show more
    Last updated: 5 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    UNCIA • Avadi, Thiruvallur (district), India
    We’re looking for a passionate Technology Lead / Engineering Manager to join our growing team and help build enterprise-grade banking products using. NET Core, Angular, and a modern microservices ar...Show more
    Last updated: 15 hours ago • Promoted • New!
    Databricks Lead

    Databricks Lead

    Mastech Digital • Ambattur, Tamil Nadu, India
    Job Title : Databricks Lead Location : Chennai / Hyderabad / Bangalore Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects Budget : ...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Architect

    Senior Data Architect

    Mphasis • Ambattur, Thiruvallur (district), India
    As a Senior Data Architect in the BFSI domain, you will be responsible for designing and governing data architecture across core banking, Wealth Management and financial platforms.You’ll lead initi...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Avadi, Thiruvallur (district), India
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 5 hours ago • Promoted • New!
    Integration Engineer

    Integration Engineer

    Bahwan CyberTek • Ambattur, Thiruvallur (district), India
    Mid-Level Integration Engineer.Support, maintain, and enhance existing Java Spring Boot microservices in a distributed environment. Design, develop, and implement ETL processes using tools like Info...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Science Engineer

    Data Science Engineer

    Populus Empowerment Network • Ambattur, Thiruvallur (district), India
    Develop and maintain backend systems for data processing and analytics.Implement and optimize machine learning models for OCR and NLP applications. Leverage Python and related frameworks to process ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Aws Cloud Devops Lead

    Aws Cloud Devops Lead

    Luxoft India • Ambattur, Thiruvallur (district), India
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write c...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Movate • Avadi, Thiruvallur (district), India
    Location : Chennai / Bangalore / .Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities. Create and execute data conversion scr...Show more
    Last updated: 5 hours ago • Promoted • New!
    Gcp Data Engineer

    Gcp Data Engineer

    Intellistaff Services Pvt. Ltd • Avadi, Thiruvallur (district), India
    Data Engineer with Python and GCP.Airflow / Astronomer / Cloud Composer (2+ Year).Tekton pipeline / CI-CD Pipeline.Strong all-round communication skills (written / presentation, one-to-one / group) & Exc...Show more
    Last updated: 5 hours ago • Promoted • New!
    Maximo Consultant - Utilities

    Maximo Consultant - Utilities

    Alcitius Consulting • Ambattur, Thiruvallur (district), India
    A leading utilities company in Middle East is looking for a senior Maximo Consultant with 7+ years’ experience to spearhead technology initiatives in utilities and distribution.This is an individua...Show more
    Last updated: 5 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    HCLTech • Ambattur, Tamil Nadu, India
    Lead and manage a team of technical professionals working on sql, data analysis, and python projects 2.Design, develop, and implement complex sql queries and scripts for data analysis 3.Analyze dat...Show more
    Last updated: 1 day ago • Promoted
    Data Science Manager

    Data Science Manager

    Live Connections • Ambattur, Thiruvallur (district), India
    Required Notice Period - Immediate Joiners or Servving Notice or max up to 60 days.Job Description / Responsibilities.We are seeking someone who has in depth understanding of both the business and ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Technical Architect - Data & Ai

    Technical Architect - Data & Ai

    HCLTech • Ambattur, Thiruvallur (district), India
    Meet regularly with other team members to discuss progress and find.Generate progress reports for clients and senior leaders. Manage organizational deliverables by using.Required skills and qualific...Show more
    Last updated: 5 hours ago • Promoted • New!
    Platform And Cloud Architect

    Platform And Cloud Architect

    ANI Pharmaceuticals, Inc. • Avadi, Thiruvallur (district), India
    Welcome to ANI Pharmaceuticals, where we are dedicated to improving and enhancing patients' lives through the manufacturing and distribution of high-quality pharmaceutical products.With a diverse p...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Technical Lead - Sql Dba

    Senior Technical Lead - Sql Dba

    HCLTech • Avadi, Thiruvallur (district), India
    Expertise in database administration in Production, Testing, and Development environments, such as configuration, Monitoring, Security, Performance Tuning, Authentication, and Troubleshooting.SQL S...Show more
    Last updated: 5 hours ago • Promoted • New!