Senior Data Engineer

American InferencePune, IN

15 days ago

Job description

Note : Please apply directly through for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg

Build scalable PySpark pipelines for batch and streaming data

Implement data quality, validation, and lineage tracking

Integrate pipelines with MLflow for experiment tracking

Optimize Spark performance and cloud cost

Ensure data governance, PII protection, and security compliance

Mentor developers and document patterns and runbooks

Required Skills

Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)

Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)

MLflow integration for MLOps pipelines

Kafka / Event Hubs for streaming data

Strong Python and data modeling (dimensional, Data Vault)

5+ years hands-on in data engineering with production-grade systems

Nice to Have

Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation

Experience with data governance technologies (such as MS Purview or similar)

Certifications : Azure Data Engineer / Databricks DE

Education

UG : B.Tech / B.E. – Computer Science / Information Technology

PG : M.Tech / M.E. / Any Postgraduate (preferred)

Why Join Us

Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.

Growth : Help shape and build our data-driven culture from the ground up.

Learning : Work with the latest in AI, code, and data technologies.

Culture : Flat hierarchy, collaborative, and outcome-driven team.

Create a job alert for this search

Senior Data Engineer • Pune, IN

Related jobs

Promoted

Senior Data Engineer

Innova SolutionsPune, Maharashtra, India

We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show moreLast updated: 17 days ago

Promoted

Senior Data Engineer

Adaptive Technology InsightsPune, IN

We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Persistent SystemsPune, Maharashtra, India

A highly skilled Data Engineering professional with 6 to 8 years of experience in designing, developing, and maintaining robust data solutions. Proven ability to work across the full software develo...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360Pune, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Persistent SystemsPune, Haveli

We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer / Architect - Snowflake

Aezion, IncPune, IN

We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

DonyatiPune, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

SAIVA AIPune, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer ( Palantir)

Lear CorporationPune, Maharashtra, India

Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show moreLast updated: 14 days ago

Promoted

Senior Data Engineer

EXLPune, Maharashtra, India

Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show moreLast updated: 17 days ago

Promoted

Senior Data Engineer

eClerxPune, Maharashtra, India

We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

TEKsystems Global Services in IndiaPune, IN

Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

MindlancePune, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago

Promoted

5447 | Senior Data Engineer

EXLPune, Maharashtra, India

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer

SPIROPune, Maharashtra, India

Position : Senior Data Engineer Location : Pune Experience : 5+ years Job Summary : We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data techn...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Fornaxpune, maharashtra, in

If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

IntelliasPune, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 17 days ago

Promoted

Senior Data Engineer - Snowflake / AWS

ResourcetreePune

About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago