Talent.com
Lead Databricks Engineer
Lead Databricks EngineerMastech Digital • Chennai, Republic Of India, IN
Lead Databricks Engineer

Lead Databricks Engineer

Mastech Digital • Chennai, Republic Of India, IN
1 day ago
Job description

Job Title : Databricks Architect

Location : Chennai / Hyderabad / Bangalore

Experience : 10–15 years of overall experience and 5+ years in Data Architecture

Budget : Open to discuss

Notice Period : Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days

About the Role

We are seeking a seasoned Databricks Architect with 10–15 years of overall experience and 5+ years in Data Architecture to lead the design and implementation of scalable, cloud-native data platforms. You will drive technical strategy, define Lakehouse architecture standards, and guide engineering teams in building high-performance data solutions.

Key Responsibilities

  • Architect and implement enterprise-scale data platforms using Databricks Lakehouse , Delta Lake, and Medallion architecture.
  • Lead end-to-end design of data ingestion, transformation, orchestration, and storage solutions.
  • Define architecture standards, best practices, governance models, and performance optimization strategies.
  • Oversee Databricks clusters, Spark workloads, and pipeline optimizations for efficiency and cost control.
  • Enable CI / CD, DevOps, and Infrastructure-as-Code (Terraform) for Databricks and cloud data platforms.
  • Collaborate with cross-functional teams on security, data governance, and cloud architecture alignment.
  • Provide technical leadership, mentoring, and solution oversight for data engineering teams.

Required Skills & Experience

  • 10–15 years in Data Engineering, Data Platforms, or Cloud Data Architecture.
  • 5+ years designing large-scale data solutions and architecting modern data platforms.
  • Hands-on expertise with Databricks , Spark, PySpark, SQL, Delta Lake, and Lakehouse principles.
  • Strong experience with AWS / Azure / GCP data services (Storage, IAM, Networking, Key Vault).
  • Proven experience implementing CI / CD, GitOps, Terraform, and Databricks Repos / Workflows.
  • Strong understanding of data governance, cataloging, lineage, and security (Unity Catalog preferred).
  • Ability to translate business needs into scalable architectural solutions
  • Preferred Qualifications

  • Databricks certifications (Data Engineer Professional, Lakehouse Architect).
  • Experience with streaming systems (Kafka, Event Hubs, Kinesis).
  • Exposure to MLflow and operationalizing ML workloads.
  • What We Offer

  • Opportunity to lead next-generation data platform initiatives.
  • Collaborative and innovative environment.
  • Competitive compensation and career growth.
  • Create a job alert for this search

    Lead Engineer • Chennai, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • India, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Staffingine LLC • India, India
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 6 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • India, India
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 14 days ago • Promoted
    Databricks Lead

    Databricks Lead

    Mastech Digital • Chennai, Republic Of India, IN
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 1 day ago • Promoted
    Databricks Engineer

    Databricks Engineer

    iDWTeam • India
    The ideal candidate will have strong expertise in Databricks, Spark, and cloud platforms (Azure / AWS / GCP), along with a solid understanding of data engineering best practices.You will work closely w...Show more
    Last updated: 2 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    IntraEdge • India, India
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Lead Engineer

    Lead Engineer

    Hyqoo • India, India
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show more
    Last updated: 23 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Nexuspoint Consultant • India, India
    We are looking for an accomplished Principal Data Engineer to lead the ideation, architecture,.You will work closely with cloud, security, and infrastructure architects to ensure seamless.Lead the ...Show more
    Last updated: 17 hours ago • Promoted • New!
    MLOps Engineer — AWS SageMaker

    MLOps Engineer — AWS SageMaker

    Hadron Talent -Hadronfinsys • India, India
    MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more
    Last updated: 15 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • India, India
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 17 hours ago • Promoted • New!
    Azure Databricks

    Azure Databricks

    Kumaran Systems • India, India
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • India
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • India, India
    Primesoft Enterprise IT Services Pvt.APIs, analytics, AI and machine learning at scale.Products team, building and maintaining production-grade pipelines and platform components that power business...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • India
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • India, India
    Remote
    These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • India, India
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 22 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • India, India
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 8 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • India, India
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 14 days ago • Promoted