Senior Data Engineer

American InferenceChennai, IN

14 days ago

Job description

Note : Please apply directly through for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg

Build scalable PySpark pipelines for batch and streaming data

Implement data quality, validation, and lineage tracking

Integrate pipelines with MLflow for experiment tracking

Optimize Spark performance and cloud cost

Ensure data governance, PII protection, and security compliance

Mentor developers and document patterns and runbooks

Required Skills

Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)

Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)

MLflow integration for MLOps pipelines

Kafka / Event Hubs for streaming data

Strong Python and data modeling (dimensional, Data Vault)

5+ years hands-on in data engineering with production-grade systems

Nice to Have

Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation

Experience with data governance technologies (such as MS Purview or similar)

Certifications : Azure Data Engineer / Databricks DE

Education

UG : B.Tech / B.E. – Computer Science / Information Technology

PG : M.Tech / M.E. / Any Postgraduate (preferred)

Why Join Us

Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.

Growth : Help shape and build our data-driven culture from the ground up.

Learning : Work with the latest in AI, code, and data technologies.

Culture : Flat hierarchy, collaborative, and outcome-driven team.

Create a job alert for this search

Senior Data Engineer • Chennai, IN

Related jobs

Promoted

Senior Data Engineer

Eucloid Data SolutionsChennai, Tamil Nadu, India

Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

DonyatiChennai, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

MastekChennai, Tamil Nadu, India

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 16 days ago

Promoted
New!

Senior Data Engineer

FornaxChennai, IN

If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 11 hours ago

Promoted

Senior Data Engineer

TECHY GEEKSChennai

About the Role : We are looking for a highly skilled and motivated Senior Data Engineer to join our team.In this role, you will be responsible for designing, building...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

Adaptive Technology InsightsChennai, IN

We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 12 hours ago

Promoted
New!

Senior Data Engineer / Architect - Snowflake

Aezion, IncChennai, IN

We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 12 hours ago

Promoted

Senior Data Engineer

SGS & CoChennai, Tamil Nadu, India

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 16 days ago

Promoted

AWS Senior Data Engineer

Tata Consultancy ServicesChennai, Tamil Nadu, India

TCS is Hiring of AWS Senior Data Engineer Experience : 5 - 10 Yrs Location : Chennai Mode of Interview : Virtual Technical Skill Set - 10 + years of Overall experience in AWS Cloud Technologies -...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

Dexian IndiaChennai, Tamil Nadu, India

Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show moreLast updated: 3 days ago

Promoted
New!

Senior Data Engineer

MindlanceChennai, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 13 hours ago

Promoted

Senior AWS Data Engineer

CYAN360Chennai, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Straivechennai, tamil nadu, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer - Snowflake / AWS

ResourcetreeChennai

About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

CYGNVSChennai, Tamil Nadu, India

Our company culture is a perfect blend of productivity and enjoyment, prioritizing the growth and development of our talented employees as part of a high-achieving team. We are in search of exceptio...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

TEKsystems Global Services in IndiaChennai, IN

Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 12 hours ago

Promoted

Senior Data Engineer

SAIVA AIChennai, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

CYGNVS - Senior Data Engineer

CYGNVS INDIA PRIVATE LIMITEDChennai

Description : CYGNVS is a purpose-built, first-of-its-kind guided cyber crisis platform designed to allow users to prepa...Show moreLast updated: 11 days ago