Talent.com
IT engineer Data Lakehouse - Tech Lead

IT engineer Data Lakehouse - Tech Lead

ContinentalShimoga, IN
8 hours ago
Job description

Job Description

Govern the enterprise-wide standards for data & analytics modeling and performance within the Databricks Lakehouse.

  • Drive consistency and reuse of core data & analytics artifacts and ensure scalable integration across all business domains.
  • Provide expert consulting, quality assurance, and enablement for data engineering and data science teams.
  • Act as a design authority for data warehouse, semantic modeling, and advanced analytics integration.
  • Acts as the senior engineering point of contact for the lakehouse layer across global teams.
  • Coordinates with 25+ data engineering and data science professionals across domains and geographies.
  • Collaborates closely with platform architects, data scientists, governance teams, and functional IT globally.

Main Tasks :

  • Define enterprise 3NF and warehouse modeling standards.
  • Maintain and review enterprise-wide data & analytics models and shared artifacts.
  • Align naming conventions and metadata handling with governance standards.
  • Guide partitioning, indexing, and performance tuning.
  • Enable, steer and optimize semantic integration with Power BI, live tabular exploration and other tools.
  • Own common functions, e.g. FX conversion, BOM logic, time-slicing.
  • Review and approve core components for quality and reusability.
  • Provide support on high-performance or high-complexity challenges.
  • Align lakehouse implementation with architectural decisions.
  • Collaborate with data science and AI teams on model deployment.
  • Ensure seamless integration of ML / AI pipelines into the lakehouse.
  • Support LLM and external API integration patterns.
  • Build and maintain shared libraries and data engineering templates.
  • Coach junior engineers and define TDD and "as-code" standards.
  • Drive engineering excellence across the community of practice.
  • Maintain architectural blueprints, templates, and best practices.
  • Publish design guidelines and coding standards.
  • Create re-usable architecture patterns for lakehouse environments.
  • Monitor usage and implement auto-scaling policies.
  • Analyze and optimize cluster configurations for cost-efficiency.
  • Provide cost transparency and usage reporting to stakeholders.
  • Qualifications

    Degree in Computer Science or related field; certifications in Databricks or Microsoft preferred.

    6–10 years in data engineering with focus on enterprise data & analytics warehouse, lakehouse modeling, and ML integration.

    Hands-on experience designing large-scale semantic, warehouse, and advanced analytics layers.

    Track record of architectural ownership and peer enablement with diverse teams.

    Experience working in international teams across multiple time zones and cultures, preferably with teams in India, Germany, and the Philippines.

    Create a job alert for this search

    Lead Data Engineer • Shimoga, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiShimoga, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy TechnologiesDavanagere, IN
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupDavanagere, IN
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneShimoga, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    IT engineer Data Lakehouse - Tech Lead

    IT engineer Data Lakehouse - Tech Lead

    ContinentalDavanagere, IN
    Govern the enterprise-wide standards for data & analytics modeling and performance within the Databricks Lakehouse.Drive consistency and reuse of core data & analytics artifacts and ensure scalable...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    IT Global Team lead - Data engineering

    IT Global Team lead - Data engineering

    ContinentalDavanagere, IN
    Lead and manage the global IT team for data engineering that develops all technical artefacts as code, implemented in professional IDEs, with full version control and CI / CD automation.This team com...Show moreLast updated: 6 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Shimoga, IN
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedShimoga, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidDavanagere, IN
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma ConsultancyShimoga, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 8 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Shimoga, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalShimoga, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Technology Lead

    Technology Lead

    WPPShimoga, IN
    WPP OPEN is WPP's proprietary, AI-powered operating system designed to connect our people, data, and technology to deliver integrated, creative, and effective solutions for our clients.It is a stra...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaDavanagere, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FornaxDavanagere, IN
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesDavanagere, IN
    Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    TTC GroupShimoga, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    KPI PartnersShimoga, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show moreLast updated: 8 hours ago