Talent.com
Senior Data Lakehouse Engineer
Senior Data Lakehouse EngineerAmerican Inference • Republic Of India, IN
Senior Data Lakehouse Engineer

Senior Data Lakehouse Engineer

American Inference • Republic Of India, IN
16 days ago
Job description

Note : Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

  • Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
  • SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
  • Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
  • Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.Js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

  • Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg
  • Build scalable PySpark pipelines for batch and streaming data
  • Implement data quality, validation, and lineage tracking
  • Integrate pipelines with MLflow for experiment tracking
  • Optimize Spark performance and cloud cost
  • Ensure data governance, PII protection, and security compliance
  • Mentor developers and document patterns and runbooks
  • Required Skills

  • Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)
  • Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)
  • MLflow integration for MLOps pipelines
  • Kafka / Event Hubs for streaming data
  • Strong Python and data modeling (dimensional, Data Vault)
  • 5+ years hands-on in data engineering with production-grade systems
  • Nice to Have

  • Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation
  • Experience with data governance technologies (such as MS Purview or similar)
  • Certifications : Azure Data Engineer / Databricks DE
  • Education

  • UG : B.Tech / B.E. – Computer Science / Information Technology
  • PG : M.Tech / M.E. / Any Postgraduate (preferred)
  • Why Join Us

  • Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.
  • Growth : Help shape and build our data-driven culture from the ground up.
  • Learning : Work with the latest in AI, code, and data technologies.
  • Culture : Flat hierarchy, collaborative, and outcome-driven team.
  • Create a job alert for this search

    Senior Data Engineer • Republic Of India, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Publicis Production • Republic Of India, IN
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Republic Of India, IN
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BlackStone eIT • IN
    Remote
    Quick Apply
    BlackStone eIT is on the lookout for a.In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data a...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • India, India
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Creditsafe Technology • India
    With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers in this regard.Creditsafe is scaling...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Donyati • India
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inference • India
    Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.We are an AI and Data ...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • Republic Of India, IN
    Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EverestDX Inc • India
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    Armakuni • India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer (Databricks Focus)

    Senior Data Engineer (Databricks Focus)

    DataE2E Technologies • Republic Of India, IN
    Lead the architecture and implementation of.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Integrate data from mu...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Publicis Production • Republic Of India, IN
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Republic Of India, IN
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • India, India
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • India, India
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • India, India
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • India
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 5 days ago • Promoted