Talent.com
Databricks Lead
Databricks LeadMastech Digital • indore, madhya pradesh, in
No longer accepting applications
Databricks Lead

Databricks Lead

Mastech Digital • indore, madhya pradesh, in
3 days ago
Job description

Job Title : Databricks Lead

Location : Chennai / Hyderabad / Bangalore

Experience : 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projects

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are looking for a highly skilled Databricks Lead with 8–10 years of overall experience and 5+ years of hands-on leadership in data engineering projects. The ideal candidate will lead teams in designing, building, and optimizing scalable data pipelines and Lakehouse solutions on Databricks.

Key Responsibilities

  • Lead the development and delivery of end-to-end data pipelines using Databricks , Spark, Delta Lake, and PySpark.
  • Drive implementation of Lakehouse / Medallion architectures (Bronze / Silver / Gold).
  • Guide and mentor data engineers, ensure best coding and architectural practices.
  • Optimize Spark jobs, Databricks clusters, and workflows for performance and cost.
  • Implement CI / CD pipelines, version control, and DevOps practices for Databricks (Repos, Workflows, Terraform).
  • Collaborate with architects, data scientists, and business teams to deliver scalable data solutions.
  • Ensure data quality, governance, security, and compliance standards are followed (Unity Catalog preferred).

Required Skills & Experience

  • 8–10 years in Data Engineering or Cloud Data Platforms.
  • 5+ years leading data engineering teams or technical delivery.
  • Strong hands-on experience with Databricks , Spark, PySpark, SQL, and Delta Lake.
  • Experience with cloud platforms (AWS / Azure / GCP) and related data services.
  • Solid understanding of data modeling, ingestion frameworks, orchestration, and performance tuning.
  • Experience with CI / CD, Git, Terraform, Databricks Repos, and Workflows.
  • Strong problem-solving, leadership, and communication skills.
  • Preferred Qualifications

  • Databricks certifications (Associate or Professional).
  • Experience with streaming technologies (Kafka, Kinesis, Event Hubs).
  • Familiarity with MLflow and data science integration.
  • What We Offer

  • Opportunity to lead cutting-edge data engineering initiatives.
  • Collaborative, high-growth environment.
  • Competitive compensation and professional development opportunities.
  • Create a job alert for this search

    Lead • indore, madhya pradesh, in

    Related jobs
    Senior Tableau Developer

    Senior Tableau Developer

    Ascentt • Indore, Madhya Pradesh, India, 452001
    Ascentt is building cutting-edge data analytics & AI / ML solutions for global automotive and manufacturing leaders.We turn enterprise data into real-time decisions using advanced machine learning an...Show more
    Last updated: 30+ days ago
    ML Ops Lead

    ML Ops Lead

    Epergne Solutions • Indore, Madhya Pradesh, India
    Quick Apply
    Roles & Responsibilities : -.Design, deploy, and manage scalable, secure, and automated ML / AI platforms across Azure and AWS. Lead MLOps lifecycle model deployment, monitoring, retraining, CI / C...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • indore, madhya pradesh, in
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 21 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • indore, madhya pradesh, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ironbook AI • indore, madhya pradesh, in
    We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
    Last updated: 21 hours ago • Promoted • New!
    Azure Data Lead / Architect

    Azure Data Lead / Architect

    Tech Mahindra • indore, madhya pradesh, in
    Role : Azure Data Lead / architect.Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault". Experience in "GIT / Jenkins / Azure DevOps".Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • indore, madhya pradesh, in
    Senior associate with hands-on working experience with Azure tool (primarily ADF / Dataflow / Databricks), building data pipelines and CICD pipelines. Having experience to process data from on-prem / C...Show more
    Last updated: 30+ days ago • Promoted
    ThoughtSpot Engineer

    ThoughtSpot Engineer

    Insight Global • indore, madhya pradesh, in
    BI / reporting tools such as ThoughtSpot, Tableau, or Power BI.Proficiency in SQL and understanding of data modeling concepts. Demonstrated ability to build complex dashboards and reports that drive b...Show more
    Last updated: 1 day ago • Promoted
    Data Engineering Manager – Web Crawling & Pipeline Architecture (2 to 7yrs)

    Data Engineering Manager – Web Crawling & Pipeline Architecture (2 to 7yrs)

    AIMLEAP • indore, India
    Data Engineering Manager – Web Crawling & Pipeline Architecture.Tech / MCA / Computer Science / IT .IT / Data / AI / E-commerce / FinTech / Healthcare . Experience working with cloud platforms such ...Show more
    Last updated: 21 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • indore, madhya pradesh, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 24 days ago • Promoted
    Lead AIML

    Lead AIML

    Mulya Technologies • indore, India
    We are a US based Stealth mode Start-up.Hyderabad / Bangalore / Remote ( any where in India ).We unify the processes used in Semiconductor and Hardware Systems design - thus reducing bugs, improvin...Show more
    Last updated: 16 hours ago • Promoted • New!
    Data Architect (12+years)

    Data Architect (12+years)

    MindBrain • Indore, Madhya Pradesh, India
    Key Responsibilities Define and execute the enterprise data architecture strategy in alignment with business goals and future growth needs. Architect, design, and implement Data Lakes, Data Warehou...Show more
    Last updated: 18 hours ago • Promoted • New!
    Lead Data Analyst

    Lead Data Analyst

    Ascentt • Indore, Madhya Pradesh, India, 452001
    Ascentt is building cutting-edge data analytics & AI / ML solutions for global automotive and manufacturing leaders.We turn enterprise data into real-time decisions using advanced machine learning an...Show more
    Last updated: 30+ days ago
    LSE / Associate Architect - Big Data

    LSE / Associate Architect - Big Data

    Impetus • Indore, Madhya Pradesh, India
    Qualification Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions Role In-depth understanding of Big data con...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineering Lead

    Data Engineering Lead

    Ascentt • Indore, Madhya Pradesh, India, 452001
    Ascentt is building cutting-edge data analytics & AI / ML solutions for global automotive and manufacturing leaders.We turn enterprise data into real-time decisions using advanced machine learning an...Show more
    Last updated: 30+ days ago
    Data Modeller Role

    Data Modeller Role

    Epergne Solutions • Indore, Madhya Pradesh, India
    Quick Apply
    Epergne Solutions is looking for Data Modeller.Long term Contract (with our Client).Chennai, Delhi, Pune, Bangalore, Indore, Gurgaon, Bhubaneshwar, Chandigarh, Hyderabad. Experience in data modellin...Show more
    Last updated: 30+ days ago
    Lead Data Engineer

    Lead Data Engineer

    Confidential • indore, India
    Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.Strong programming skills in Python, Java, C++, SQL etc. Advanced knowledge of a major ...Show more
    Last updated: 16 hours ago • Promoted • New!
    Enterprise Application Developer (FP&A and Data Integration)

    Enterprise Application Developer (FP&A and Data Integration)

    DRISHTICON Inc • indore, madhya pradesh, in
    Job Title : Experienced Anaplan Model Builder (FP&A & Data Integration).The position is long term contract and Remote.Nice to have skills : FP&A knowledge or certification, Anaplan Data Integration u...Show more
    Last updated: 21 hours ago • Promoted • New!