Talent.com
Databricks Lead
Databricks LeadMastech Digital • bhopal, madhya pradesh, in
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • bhopal, madhya pradesh, in
2 days ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • bhopal, madhya pradesh, in

    Related jobs
    Data Engineer

    Data Engineer

    ShimentoX Technologies • bhopal, madhya pradesh, in
    Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL. Must have proven background in building data connectors.Experience s...Show more
    Last updated: 18 hours ago • Promoted • New!
    Snowflake Lead / Architect

    Snowflake Lead / Architect

    Boolean Data Systems • bhopal, India
    Job Tittle : Snowflake Lead / Architect.Boolean Data Systems is a system integration company focusing on Snowflake products. We focus on helping companies implement innovative solutions combining Peopl...Show more
    Last updated: 11 days ago • Promoted
    MLOps Engineer — AWS SageMaker

    MLOps Engineer — AWS SageMaker

    Hadron Talent -Hadronfinsys • bhopal, India
    MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more
    Last updated: 3 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • bhopal, madhya pradesh, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 22 days ago • Promoted
    Senior Tech Lead CRM Developer with AI Builder Experience

    Senior Tech Lead CRM Developer with AI Builder Experience

    GTRTeK • bhopal, madhya pradesh, in
    Microsoft Dynamics CRM 365 Senior Developer with minimum 5 years of experience in D 365 CRM along with .Looking for competent candidate in the relevant module. Minimum 3 years of work experience .Bu...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Full Stack Engineer

    Senior Full Stack Engineer

    OWOW • bhopal, madhya pradesh, in
    Front-end technologies like ReactJS, Redux, TypeScript, Tailwind CSS.Exposure to other cloud platforms beyond AWS.Experience with microservices or event-driven architectures.Familiarity with AWS La...Show more
    Last updated: 26 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • bhopal, madhya pradesh, in
    Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
    Last updated: 18 hours ago • Promoted • New!
    Lead Database Administrator

    Lead Database Administrator

    Ironbook AI • bhopal, madhya pradesh, in
    We are seeking an experienced Lead Database Administrator / Developer with deep expertise in.The ideal candidate will play a key role in modernizing our database infrastructure, leading large-scale m...Show more
    Last updated: 18 hours ago • Promoted • New!
    Technical Lead – Web Crawling Systems, Data Pipelines

    Technical Lead – Web Crawling Systems, Data Pipelines

    AIMLEAP • bhopal, madhya pradesh, in
    Tech / MCA / Computer Science / IT.Industry : IT / Data / AI / E-commerce / FinTech / Healthcare.Proven experience leading data engineering teams with strong ownership of web crawling systems and pi...Show more
    Last updated: 18 hours ago • Promoted • New!
    Lead Consultant-Digital services- Backend (.net with Sharepoint)-Bhopal / Vadodara

    Lead Consultant-Digital services- Backend (.net with Sharepoint)-Bhopal / Vadodara

    BDO India • Bhopal, Madhya Pradesh, India
    BDO is a global network of professional services firms with a presence in over 166 countries, revenue of over USD 14 billion, and experience of over 60 years. It’s a leading service provider for the...Show more
    Last updated: 3 days ago • Promoted
    AWS Solution Architect

    AWS Solution Architect

    Saxon AI • bhopal, madhya pradesh, in
    We are looking for a highly skilled.Architecture & System Modernization.Own the redesign of the Truscan backend architecture : . Multi-stage compute pipeline (Stage 1–4).High-performance Python worker...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • bhopal, madhya pradesh, in
    Job Title : Senior SQL Developer.Shift Timings : 2 : 30 PM - 11 : 30 PM IST.Location : Remote, India, Work from Home.Experience Required : 7 - 13 Years. Design, develop, and maintain SQL Server database...Show more
    Last updated: 28 days ago • Promoted
    Lead of AI

    Lead of AI

    TIGI HR • bhopal, India
    This position is central to shaping the AI strategy and data capabilities of a rapidly growing technology startup focused on transforming how manufacturers understand and address complex Scope 3 su...Show more
    Last updated: 3 hours ago • Promoted • New!
    Principal Data Engineer

    Principal Data Engineer

    Nexuspoint Consultant • bhopal, madhya pradesh, in
    We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture,.You will work closely with cloud, security, and infrastructure architects to ensure seamless.Lead the ...Show more
    Last updated: 18 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • bhopal, madhya pradesh, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 18 hours ago • Promoted • New!
    Azure DevOps Data Engineer

    Azure DevOps Data Engineer

    Paritas Recruitment • bhopal, madhya pradesh, in
    Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    TerraGiG • bhopal, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 2 days ago • Promoted
    Senior Implementation Specialist (PowerScale / Isilon)

    Senior Implementation Specialist (PowerScale / Isilon)

    Norwin Technologies • bhopal, madhya pradesh, in
    Senior Implementation Specialist.Interested candidates can share profile on anjalihb@norwintechnologies.Administer and optimize PowerScale clusters across Multi-potocols (NFS / SMB / HDFS / S3) environme...Show more
    Last updated: 18 hours ago • Promoted • New!