Talent.com
Databricks Lead
Databricks LeadMastech Digital • Pune, IN
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • Pune, IN
1 day ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • Pune, IN

    Related jobs
    Azure databricks

    Azure databricks

    LTIMindtree • Pune, IN
    Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Pune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Pune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 14 days ago • Promoted
    Solutions Manager – Tech Data Lead

    Solutions Manager – Tech Data Lead

    Entytle • Pune, Maharashtra, India
    Solutions Manager – Tech Data Lead.Entytle is on a mission to transform the Aftermarket for industrial OEMs using .AI-driven Installed Base Intelligence. Our platform helps the world’s leading equip...Show more
    Last updated: 19 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, Maharashtra, India
    Location : Banglore / Pune (Hybrid).This role is critical to building a robust data foundation for training thousands of AI models that detect anomalous behavior across applications, services, and fun...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 16 days ago • Promoted
    Data Solutions Director

    Data Solutions Director

    Amethyst Partners • Pune, IN
    This role carries both strategic and operational leadership responsibilities, managing Principal Analysts across APAC and working closely with data engineering, development, and global teams.You wi...Show more
    Last updated: 12 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Pune, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 19 days ago • Promoted
    Senior Data Architect

    Senior Data Architect

    Tata Consultancy Services • Pune, Maharashtra, India
    TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hi...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Architect

    Lead Data Architect

    Bajaj Technology Services • Pune, Maharashtra, India
    Build strong technical relationships with customer technology SMEs, actively engaging in the co-creation of innovative solutions in areas such as Modern Data Technologies like Spark, KAFKA, NoSQL D...Show more
    Last updated: 7 days ago • Promoted
    Data Integration Developer (Level 1)

    Data Integration Developer (Level 1)

    Blutic • Pune, IN
    Data Integration Developer (Level 1).ETL processes and reports using.This entry-level role is ideal for developers looking to grow their skills in enterprise data solutions while contributing to cr...Show more
    Last updated: 19 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Pune, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 14 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Tata Consultancy Services • Pune, Maharashtra, India
    Job title : Azure Data Engineer.Job Location : Kolkata, Pune, Bangalore, New Delhi.Virtual Interview : 28th Nov (Friday). Build the solution for optimal extraction, transformation, and loading of data...Show more
    Last updated: 8 days ago • Promoted
    Technical Lead – Data Platforms

    Technical Lead – Data Platforms

    Zywave • Pune, Maharashtra, India
    Technical Lead – Data Engineering (Snowflake, SQL Server, Data Architecture).Kharadi, Pune (Work from Office – 5 Days a Week). Medallion Architecture, Data Mesh) to lead the design and implementatio...Show more
    Last updated: 19 days ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • pune, India
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Pune, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 14 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Pune, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReady • Pune, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show more
    Last updated: 12 days ago • Promoted