Talent.com
This job offer is not available in your country.
Databricks lead

Databricks lead

RecroIndia
30+ days ago
Job description

Designation - Databricks lead

Experience - 8+ Years

Key Responsibilities

  • Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks.
  • Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.
  • Collaborate with stakeholders to translate businessrequirementsinto technical solutions.
  • Oversee the migration of on-premises data systemsto Databricks cloud environments.
  • Drive best practicesin data governance, security, and performance optimization.
  • Provide technical leadership, mentorship, and support to data engineering teams.
  • Work closely with data scientiststo productionize machine learning models.
  • Establish monitoring, logging, and automated testing for data pipelines.
  • Ensure compliance with industry standards,security protocols, and regulatory requirements.
  • Evaluate new featuresin Databricks and recommend adoption strategies.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • 8+ years of experience in data engineering, with 3+ years in Databricks.
  • Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
  • Proven experience with Databricks on Azure, AWS, or GCP.
  • Hands-on experience in designing large-scale ETL / ELT workflows.
  • Proficiency in cloud storage (S3, ADLS, GCS) and data warehousing solutions (Snowflake, Redshift,
  • Synapse, BigQuery).

  • Strong knowledge of DevOps, CI / CD, and Infrastructure as Code (Terraform / CloudFormation).
  • Experience in MLflow, feature engineering, and integrating machine learning pipelines.
  • Excellent communication, leadership, and stakeholder managementskills.
  • Databricks certification(s) such as Databricks Certified Data Engineer Professional or Databricks
  • Certified Machine Learning Professional preferred.

    Preferred Skills

  • Experience with streaming technologies(Kafka, Event Hubs, Kinesis).
  • Knowledge of data governance frameworks(Collibra, Purview).
  • Familiarity with BI / visualization tools(Power BI, Tableau, Looker).
  • Create a job alert for this search

    Lead • India

    Related jobs
    • Promoted
    Data Architect

    Data Architect

    InfoBeansNagpur, IN
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesNagpur, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesNagpur, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Lead / Architect Data and AI Platform

    Lead / Architect Data and AI Platform

    AkkodisIndia, India
    Deep experience building on-premises or hybrid data systems (e.Spark, Kafka, Trino, Iceberg, Airflow).Strong understanding of LLM architecture, embeddings, vector search, and agentic workflows.Prov...Show moreLast updated: 18 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesNagpur, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Data Architect

    Data Architect

    G10XNagpur, IN
    Senior Data Architect (15+ Years Experience).We are looking for a seasoned Data Architect to lead and shape enterprise-wide data initiatives. This role requires a strategic leader with deep technica...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Databricks SQL Engineer with Commercial Pharma

    Databricks SQL Engineer with Commercial Pharma

    KeasisNagpur, IN
    Job Title : Databricks SQL Engineer with Commercial Pharma.We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL.The ideal candidate will ...Show moreLast updated: 10 hours ago
    • Promoted
    Data Analyst (BigQuery, GA4 data and Github DBT)

    Data Analyst (BigQuery, GA4 data and Github DBT)

    KeyrusNagpur, IN
    We are looking for a detail-oriented.Data Quality & Transformation Analyst.You will assess data quality, design and implement the required transformations, and collaborate closely with our global a...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsNagpur, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    SAP Datasphere Owner

    SAP Datasphere Owner

    RED GlobalNagpur, IN
    Duration : Until September 2026 with multiple extensions.Act as primary solution owner for SAP BDC platform and related components (SAC, Datasphere). Define platform Solution Architecture standards a...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineering Azure databricks

    Data Engineering Azure databricks

    EXLNagpur, IN
    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 10 hours ago
    • Promoted
    SAP Lead

    SAP Lead

    Ajiledone TechnologiesNagpur, IN
    SAP CPI Consultant (Contract Role).We are seeking an experienced SAP CPI Consultant for a contract position, requiring 5-15 years of overall experience with a minimum of 2-3 end-to-end implementati...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Nagpur, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AINagpur, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudNagpur, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    SAP Data Migration Lead

    SAP Data Migration Lead

    RED GlobalNagpur, IN
    SAP S / 4HANA SAP - Data Migration techno-functional consultant - October - 12 month Contract.You must 100% available for this role and not working other roles at the same time.RED Global have partne...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    ETL LEAD with IBM DataStage experienced

    ETL LEAD with IBM DataStage experienced

    IntraEdgeNagpur, IN
    ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AINagpur, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalNagpur, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago