Talent.com
Databricks Lead
Databricks LeadMastech Digital • Surat, IN
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • Surat, IN
2 days ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • Surat, IN

    Related jobs
    Azure Data Lead / Architect

    Azure Data Lead / Architect

    Tech Mahindra • Surat, IN
    Role : Azure Data Lead / architect.Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault". Experience in "GIT / Jenkins / Azure DevOps".Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Surat, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 15 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • Surat, IN
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 9 days ago • Promoted
    Data Engineering Lead

    Data Engineering Lead

    Kanerika Inc • Surat, Gujarat, India
    Job Location : Ahmedabad What You Will Do : - Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes. Design, implement, and optimize P...Show more
    Last updated: 29 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Surat, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 15 days ago • Promoted
    IDMC Lead

    IDMC Lead

    LumenData • Surat, IN
    LumenData is a recognized leader in modern data architecture and cloud data management.We specialize in implementing cutting-edge solutions using Informatica’s Cloud Data Management suite, deliveri...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture ( 7 to 2 yrs)

    AIMLEAP • Surat, Gujarat, India
    Data Engineering Manager – Web Crawling & Pipeline Architecture Experience : 7 to 12 Years Location : Remote / Bangalore Engagement : Full-time Positions : 2 Qualification : B.Tech / MCA / Compute...Show more
    Last updated: 4 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Surat, IN
    Environment review, architecture diagrams.AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. AWS Certified Solutions Archite...Show more
    Last updated: 20 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Surat, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 8 days ago • Promoted
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    Blutic • Surat, IN
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show more
    Last updated: 20 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • Surat, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 1 day ago • Promoted
    Technical Lead – Web Crawling Systems, Data Pipelines

    Technical Lead – Web Crawling Systems, Data Pipelines

    AIMLEAP • surat, India
    Tech / MCA / Computer Science / IT.Industry : IT / Data / AI / E-commerce / FinTech / Healthcare.Proven experience leading data engineering teams with strong ownership of web crawling systems and pi...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReady • Surat, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Surat, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Surat, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 14 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • mohali, gujarat, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Surat, Gujarat, India
    Lead Data Engineer – Azure Cloud We are looking for an experienced Lead Data Engineer to build and manage a robust data platform on Azure Cloud. The ideal candidate will design, develop, and mainta...Show more
    Last updated: 22 days ago • Promoted
    KINAXIS ARCHITECT

    KINAXIS ARCHITECT

    Delta System & Software, Inc. • Surat, Gujarat, India
    ROLE : KINAXIS ARCHITECT Client : Delta Systems & Software Pvt.Location : Remote Job Description : Candidate should have a minimum of 3-4 years of Kinaxis Rapid Response application development.Should...Show more
    Last updated: 19 days ago • Promoted