Senior Data Lakehouse EngineerAmerican Inference • Republic Of India, IN

Senior Data Lakehouse Engineer

American Inference • Republic Of India, IN

18 days ago

Job description

Note : Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.Js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg

Build scalable PySpark pipelines for batch and streaming data

Implement data quality, validation, and lineage tracking

Integrate pipelines with MLflow for experiment tracking

Optimize Spark performance and cloud cost

Ensure data governance, PII protection, and security compliance

Mentor developers and document patterns and runbooks

Required Skills

Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)

Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)

MLflow integration for MLOps pipelines

Kafka / Event Hubs for streaming data

Strong Python and data modeling (dimensional, Data Vault)

5+ years hands-on in data engineering with production-grade systems

Nice to Have

Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation

Experience with data governance technologies (such as MS Purview or similar)

Certifications : Azure Data Engineer / Databricks DE

Education

UG : B.Tech / B.E. – Computer Science / Information Technology

PG : M.Tech / M.E. / Any Postgraduate (preferred)

Why Join Us

Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.

Growth : Help shape and build our data-driven culture from the ground up.

Learning : Work with the latest in AI, code, and data technologies.

Culture : Flat hierarchy, collaborative, and outcome-driven team.

Create a job alert for this search

Senior Data Engineer • Republic Of India, IN

Related jobs

Senior Data Engineer

VRIZE • India, India

Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more

Last updated: 5 days ago • Promoted

Data Engineer

BayOne Solutions • India, India

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

TerraGiG • India, India

Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more

Last updated: 22 hours ago • Promoted • New!

Senior Data Engineer

Publicis Production • Republic Of India, IN

We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more

Last updated: 5 days ago • Promoted

Senior Data Solutions Engineer

CXC • Republic Of India, IN

Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more

Last updated: 14 hours ago • Promoted • New!

Data Engineer

Insight Global • India, India

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

CXC • India, India

Last updated: 22 hours ago • Promoted • New!

Senior Data Engineer

Live Connections • India, India

Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more

Last updated: 8 days ago • Promoted

Data Engineer

IntraEdge • India, India

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Aceolution • India, India

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer - Data Acquisition

InfoBeans • India, India

We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more

Last updated: 19 days ago • Promoted

Senior Data Engineer

Primesoft Inc • India, India

Primesoft Enterprise IT Services Pvt.APIs, analytics, AI and machine learning at scale.Products team, building and maintaining production-grade pipelines and platform components that power business...Show more

Last updated: 3 days ago • Promoted

Customer Engineer (Data Engineer)

Konecta • India

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer - Data Acquisition

InfoBeans • India, India

Last updated: 19 days ago • Promoted

Senior Data Engineer

SAIVA AI • India, India

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

Senior Oracle Data Engineer

Strattek Consulting • India, India

This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more

Last updated: 12 days ago • Promoted

GCP Data Engineer

PamTen Inc • India, India

You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more

Last updated: 19 days ago • Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • India, India

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 12 days ago • Promoted