Talent.com
Senior Data Lakehouse Engineer
Senior Data Lakehouse EngineerAmerican Inference • Republic Of India, IN
Senior Data Lakehouse Engineer

Senior Data Lakehouse Engineer

American Inference • Republic Of India, IN
16 days ago
Job description

Note : Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

  • Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
  • SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
  • Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
  • Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.Js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

  • Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg
  • Build scalable PySpark pipelines for batch and streaming data
  • Implement data quality, validation, and lineage tracking
  • Integrate pipelines with MLflow for experiment tracking
  • Optimize Spark performance and cloud cost
  • Ensure data governance, PII protection, and security compliance
  • Mentor developers and document patterns and runbooks
  • Required Skills

  • Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)
  • Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)
  • MLflow integration for MLOps pipelines
  • Kafka / Event Hubs for streaming data
  • Strong Python and data modeling (dimensional, Data Vault)
  • 5+ years hands-on in data engineering with production-grade systems
  • Nice to Have

  • Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation
  • Experience with data governance technologies (such as MS Purview or similar)
  • Certifications : Azure Data Engineer / Databricks DE
  • Education

  • UG : B.Tech / B.E. – Computer Science / Information Technology
  • PG : M.Tech / M.E. / Any Postgraduate (preferred)
  • Why Join Us

  • Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.
  • Growth : Help shape and build our data-driven culture from the ground up.
  • Learning : Work with the latest in AI, code, and data technologies.
  • Culture : Flat hierarchy, collaborative, and outcome-driven team.
  • Create a job alert for this search

    Senior Data Engineer • Republic Of India, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Publicis Production • Republic Of India, IN
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Republic Of India, IN
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BlackStone eIT • IN
    Remote
    Quick Apply
    BlackStone eIT is on the lookout for a.In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data a...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • India, India
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Chennai, Republic Of India, IN
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Google Cloud Platform)

    Senior Data Engineer (Google Cloud Platform)

    Pixeldust Technologies • Pune, Republic Of India, IN
    We are seeking a highly skilled Data Engineer - GCP with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP).The ideal candidate ...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • India
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 10 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • Republic Of India, IN
    Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Publicis Production • Republic Of India, IN
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer (Databricks Focus)

    Senior Data Engineer (Databricks Focus)

    DataE2E Technologies • Republic Of India, IN
    Lead the architecture and implementation of.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Integrate data from mu...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Publicis Production • Republic Of India, IN
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Republic Of India, IN
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inference • Republic Of India, IN
    Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.We are an AI and Data ...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • India, India
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • India, India
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 15 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • India, India
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ListenFirst • Jaipur, Republic Of India, IN
    We are looking for a skilled and motivated Senior Data Engineer with strong experience in data engineering and ETL processes. The ideal candidate should be comfortable working with any object-orient...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Republic Of India, IN
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 16 days ago • Promoted