Talent.com
No longer accepting applications
IT engineer Data Lakehouse - Tech Lead

IT engineer Data Lakehouse - Tech Lead

ContinentalPune, IN
1 day ago
Job description

Job Description

Govern the enterprise-wide standards for data & analytics modeling and performance within the Databricks Lakehouse.

  • Drive consistency and reuse of core data & analytics artifacts and ensure scalable integration across all business domains.
  • Provide expert consulting, quality assurance, and enablement for data engineering and data science teams.
  • Act as a design authority for data warehouse, semantic modeling, and advanced analytics integration.
  • Acts as the senior engineering point of contact for the lakehouse layer across global teams.
  • Coordinates with 25+ data engineering and data science professionals across domains and geographies.
  • Collaborates closely with platform architects, data scientists, governance teams, and functional IT globally.

Main Tasks :

  • Define enterprise 3NF and warehouse modeling standards.
  • Maintain and review enterprise-wide data & analytics models and shared artifacts.
  • Align naming conventions and metadata handling with governance standards.
  • Guide partitioning, indexing, and performance tuning.
  • Enable, steer and optimize semantic integration with Power BI, live tabular exploration and other tools.
  • Own common functions, e.g. FX conversion, BOM logic, time-slicing.
  • Review and approve core components for quality and reusability.
  • Provide support on high-performance or high-complexity challenges.
  • Align lakehouse implementation with architectural decisions.
  • Collaborate with data science and AI teams on model deployment.
  • Ensure seamless integration of ML / AI pipelines into the lakehouse.
  • Support LLM and external API integration patterns.
  • Build and maintain shared libraries and data engineering templates.
  • Coach junior engineers and define TDD and "as-code" standards.
  • Drive engineering excellence across the community of practice.
  • Maintain architectural blueprints, templates, and best practices.
  • Publish design guidelines and coding standards.
  • Create re-usable architecture patterns for lakehouse environments.
  • Monitor usage and implement auto-scaling policies.
  • Analyze and optimize cluster configurations for cost-efficiency.
  • Provide cost transparency and usage reporting to stakeholders.
  • Qualifications

    Degree in Computer Science or related field; certifications in Databricks or Microsoft preferred.

    6–10 years in data engineering with focus on enterprise data & analytics warehouse, lakehouse modeling, and ML integration.

    Hands-on experience designing large-scale semantic, warehouse, and advanced analytics layers.

    Track record of architectural ownership and peer enablement with diverse teams.

    Experience working in international teams across multiple time zones and cultures, preferably with teams in India, Germany, and the Philippines.

    Create a job alert for this search

    Lead Data Engineer • Pune, IN

    Related jobs
    • Promoted
    • New!
    IT Global Team lead - Data engineering

    IT Global Team lead - Data engineering

    Continentalpune, India
    Lead and manage the global IT team for data engineering that develops all technical artefacts as code, implemented in professional IDEs, with full version control and CI / CD automation.This team com...Show moreLast updated: 8 hours ago
    • Promoted
    Lead Engineer

    Lead Engineer

    HyqooPune, IN
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show moreLast updated: 12 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedPune, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdPune, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Lead Engineer

    Azure Data Lead Engineer

    Persistent Systemspune, maharashtra, in
    We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent SystemsPune, Maharashtra, India
    About Position : We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snow...Show moreLast updated: 5 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Technical lead - Platform Engineer

    Technical lead - Platform Engineer

    MUFG Pension & Market ServicesPune, Maharashtra, India
    Description for Internal Candidates.The Individual will lead the team from a technical perspective and provide IT support related to the MPMS Retirement Solutions application environments and inter...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Lead

    Technical Lead

    ThoughtquadPune, India
    We’re Hiring : Senior AWS Back-End Engineer (Technical Lead).We’re looking for a highly experienced, hands-on Senior AWS Back-End Engineer to serve as the Technical Lead for an agile squad.This is a...Show moreLast updated: 1 day ago
    • Promoted
    Atgeir Solutions - Technology Lead - Big Data / Cloud Platform

    Atgeir Solutions - Technology Lead - Big Data / Cloud Platform

    Atgeir SolutionsPune
    At Atgeir Solutions, we are pioneers in technological innovation, dedicated to achieving excellence in every endeavor.We are currently seeking a dynamic Technical Lead with a specialization in Big ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncPune, Maharashtra, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 25 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.pune, India
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalPune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Big Data Engineer

    Lead Big Data Engineer

    Devlats Pvt LtdPune
    We are seeking a talented Lead Big Data Engineer to deliver roadmap features which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy Technologiespune, India
    We’re Hiring : LEAD DATA ENGINEER.Show moreLast updated: 13 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXLPune, Maharashtra, India
    About the Role We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions.Th...Show moreLast updated: 2 days ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma ConsultancyPune, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC GroupPune, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago