Talent.com
Lead Databricks Engineer
Lead Databricks EngineerMastech Digital • Chennai, Republic Of India, IN
Lead Databricks Engineer

Lead Databricks Engineer

Mastech Digital • Chennai, Republic Of India, IN
1 day ago
Job description

Job Title : Databricks Architect

Location : Chennai / Hyderabad / Bangalore

Experience : 10–15 years of overall experience and 5+ years in Data Architecture

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are seeking a seasoned Databricks Architect with 10–15 years of overall experience and 5+ years in Data Architecture to lead the design and implementation of scalable, cloud-native data platforms. You will drive technical strategy, define Lakehouse architecture standards, and guide engineering teams in building high-performance data solutions.

Key Responsibilities

  • Architect and implement enterprise-scale data platforms using Databricks Lakehouse , Delta Lake, and Medallion architecture.
  • Lead end-to-end design of data ingestion, transformation, orchestration, and storage solutions.
  • Define architecture standards, best practices, governance models, and performance optimization strategies.
  • Oversee Databricks clusters, Spark workloads, and pipeline optimizations for efficiency and cost control.
  • Enable CI / CD, DevOps, and Infrastructure-as-Code (Terraform) for Databricks and cloud data platforms.
  • Collaborate with cross-functional teams on security, data governance, and cloud architecture alignment.
  • Provide technical leadership, mentoring, and solution oversight for data engineering teams.

Required Skills & Experience

  • 10–15 years in Data Engineering, Data Platforms, or Cloud Data Architecture.
  • 5+ years designing large-scale data solutions and architecting modern data platforms.
  • Hands-on expertise with Databricks , Spark, PySpark, SQL, Delta Lake, and Lakehouse principles.
  • Strong experience with AWS / Azure / GCP data services (Storage, IAM, Networking, Key Vault).
  • Proven experience implementing CI / CD, GitOps, Terraform, and Databricks Repos / Workflows.
  • Strong understanding of data governance, cataloging, lineage, and security (Unity Catalog preferred).
  • Ability to translate business needs into scalable architectural solutions
  • Preferred Qualifications

  • Databricks certifications (Data Engineer Professional, Lakehouse Architect).
  • Experience with streaming systems (Kafka, Event Hubs, Kinesis).
  • Exposure to MLflow and operationalizing ML workloads.
  • What We Offer

  • Opportunity to lead next-generation data platform initiatives.
  • Collaborative and innovative environment.
  • Competitive compensation and career growth.
  • Create a job alert for this search

    Lead Engineer • Chennai, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • India, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Staffingine LLC • India, India
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 6 days ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • Chennai, Republic Of India, IN
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 2 days ago • Promoted
    Databricks Technical Lead

    Databricks Technical Lead

    ZIDEA • Republic Of India, IN
    Role : Technical Lead — Databricks (Data Platform Operations).General shift (weekend / night support only when required). We’re looking for a seasoned Technical Lead who can guide a Databricks operatio...Show more
    Last updated: 6 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • India, India
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • India, India
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Lead Engineer

    Lead Engineer

    Hyqoo • India, India
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show more
    Last updated: 24 days ago • Promoted
    MLOps Engineer — AWS SageMaker

    MLOps Engineer — AWS SageMaker

    Hadron Talent -Hadronfinsys • India, India
    MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more
    Last updated: 22 hours ago • Promoted • New!
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • India, India
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 14 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • India, India
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 1 day ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • India, India
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • India, India
    Remote
    These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • India, India
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Quess IT Staffing • India
    Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.Develop and orchestrate workflows using Apache Airflow and Spark.S3, Glue, At...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy Services • Republic Of India, IN
    Hyderabad, Noida, Chennai, Mumbai.Azure Databricks using Scala, PySpark.Experience of full Software Development Life Cycle experience. Design and develop reusable software modules that meet customer...Show more
    Last updated: 30+ days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • India, India
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 8 days ago • Promoted
    Data Analytics Engineer

    Data Analytics Engineer

    Cube Consultancy Services • India
    We are seeking a skilled and motivated Data Analytics Engineer to join our growing data.This role is ideal for someone with a strong foundation in SQL, experience using Sigma.Computing, and a deep ...Show more
    Last updated: 4 hours ago • Promoted • New!