Talent.com
IT engineer Data Lakehouse - Tech Lead
IT engineer Data Lakehouse - Tech LeadContinental • Kanpur, Uttar Pradesh, India
No longer accepting applications
IT engineer Data Lakehouse - Tech Lead

IT engineer Data Lakehouse - Tech Lead

Continental • Kanpur, Uttar Pradesh, India
1 day ago
Job description

Job Description

Govern the enterprise-wide standards for data & analytics modeling and performance within the Databricks Lakehouse.

  • Drive consistency and reuse of core data & analytics artifacts and ensure scalable integration across all business domains.
  • Provide expert consulting, quality assurance, and enablement for data engineering and data science teams.
  • Act as a design authority for data warehouse, semantic modeling, and advanced analytics integration.
  • Acts as the senior engineering point of contact for the lakehouse layer across global teams.
  • Coordinates with 25+ data engineering and data science professionals across domains and geographies.
  • Collaborates closely with platform architects, data scientists, governance teams, and functional IT globally.

Main Tasks :

  • Define enterprise 3NF and warehouse modeling standards.
  • Maintain and review enterprise-wide data & analytics models and shared artifacts.
  • Align naming conventions and metadata handling with governance standards.
  • Guide partitioning, indexing, and performance tuning.
  • Enable, steer and optimize semantic integration with Power BI, live tabular exploration and other tools.
  • Own common functions, e.g. FX conversion, BOM logic, time-slicing.
  • Review and approve core components for quality and reusability.
  • Provide support on high-performance or high-complexity challenges.
  • Align lakehouse implementation with architectural decisions.
  • Collaborate with data science and AI teams on model deployment.
  • Ensure seamless integration of ML / AI pipelines into the lakehouse.
  • Support LLM and external API integration patterns.
  • Build and maintain shared libraries and data engineering templates.
  • Coach junior engineers and define TDD and "as-code" standards.
  • Drive engineering excellence across the community of practice.
  • Maintain architectural blueprints, templates, and best practices.
  • Publish design guidelines and coding standards.
  • Create re-usable architecture patterns for lakehouse environments.
  • Monitor usage and implement auto-scaling policies.
  • Analyze and optimize cluster configurations for cost-efficiency.
  • Provide cost transparency and usage reporting to stakeholders.
  • Qualifications

    Degree in Computer Science or related field; certifications in Databricks or Microsoft preferred.

    6–10 years in data engineering with focus on enterprise data & analytics warehouse, lakehouse modeling, and ML integration.

    Hands-on experience designing large-scale semantic, warehouse, and advanced analytics layers.

    Track record of architectural ownership and peer enablement with diverse teams.

    Experience working in international teams across multiple time zones and cultures, preferably with teams in India, Germany, and the Philippines.

    Create a job alert for this search

    Lead Data Engineer • Kanpur, Uttar Pradesh, India

    Related jobs
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancy • Kanpur, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
    Last updated: 1 day ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Kanpur, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    BayOne Solutions • Kanpur, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Kanpur, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Kanpur, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.Ai • Kanpur, IN
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show more
    Last updated: 5 hours ago • Promoted • New!
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglite • Kanpur, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360 • Kanpur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Kanpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Lead Engineer

    Lead Engineer

    Hyqoo • Kanpur, IN
    Design, deploy, and manage AWS cloud infrastructure, including EC2 instances, S3 buckets, VPCs, RDS databases, and Lambda functions. Assist in the design, implementation, and maintenance of backup, ...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Kanpur, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Group • Kanpur, IN
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
    Last updated: 1 day ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INC • Kanpur, IN
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Kanpur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Kanpur, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Kanpur, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Kanpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 18 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Kanpur, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 3 days ago • Promoted