Senior Data Engineer

American Inferencebhopal, madhya pradesh, in

13 hours ago

Job description

About the Company

We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines :

Consulting Services : AI Strategy, Automation, and Digital Transformation for enterprises.
SaaS Platform Development : Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly.
Data Lakehouse Solutions : Unified data pipelines for aggregation, cleaning, governance, and advanced analytics.
Government Contracting : Developing secure, compliant AI solutions for the public sector.

Our tech stack includes Python, TypeScript, React, Next.js, Go, Rust, Azure, Kubernetes, Spark, MLflow, Postgres, graph databases, and vector stores.

We're a small, fast-moving team delivering enterprise-grade solutions with startup agility.

Role Overview

You will design, build, and optimize data lakehouse solutions, enabling analytics, AI, and MLOps across multiple clients.

Key Responsibilities

Design lakehouse architectures (Bronze / Silver / Gold) using Azure Databricks, Delta Lake, or Iceberg

Build scalable PySpark pipelines for batch and streaming data

Implement data quality, validation, and lineage tracking

Integrate pipelines with MLflow for experiment tracking

Optimize Spark performance and cloud cost

Ensure data governance, PII protection, and security compliance

Mentor developers and document patterns and runbooks

Required Skills

Apache Spark (PySpark) and SQL (complex joins, CTEs, optimization)

Delta Lake / Iceberg and Azure Data Stack (ADLS, Synapse, Databricks)

MLflow integration for MLOps pipelines

Kafka / Event Hubs for streaming data

Strong Python and data modeling (dimensional, Data Vault)

5+ years hands-on in data engineering with production-grade systems

Nice to Have

Vector databases, dbt, Airflow, Terraform, FinOps exposure, and Great Expectations data validation

Experience with data governance technologies (such as MS Purview or similar)

Certifications : Azure Data Engineer / Databricks DE

Education

UG : B.Tech / B.E. – Computer Science / Information Technology

PG : M.Tech / M.E. / Any Postgraduate (preferred)

Why Join Us

Impact : You'll have significant influence over our data architecture and enable AI / ML capabilities across the organization.

Growth : Help shape and build our data-driven culture from the ground up.

Learning : Work with the latest in AI, code, and data technologies.

Culture : Flat hierarchy, collaborative, and outcome-driven team.

Create a job alert for this search

Senior Data Engineer • bhopal, madhya pradesh, in

Related jobs

Promoted
New!

Senior Data Engineer

Eucloid Data Solutionsbhopal, madhya pradesh, in

Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show moreLast updated: 13 hours ago

Promoted

Senior Data Engineer

SAIVA AIbhopal, madhya pradesh, in

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

ACL Digitalbhopal, madhya pradesh, in

We are looking for professionals with expertise in Data Engineering.Data Engineer (We are looking for 7 to 10years of experience) and Tech Lead – Data Engineer -( looking for 10+ years of experienc...Show moreLast updated: 1 day ago

Promoted

Senior Azure Data Engineer

Programmers.iobhopal, madhya pradesh, in

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

Ascendionbhopal, madhya pradesh, in

We’re Hiring – GCP BigQuery Developers!.Are you passionate about building scalable data solutions and working with cutting-edge cloud technologies?. Bangalore / Hyderabad / Chennai / Pune.Immediate to 15 ...Show moreLast updated: 13 hours ago

Promoted

Data Engineer

thinkbridgebhopal, madhya pradesh, in

We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Mastekbhopal, madhya pradesh, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer-Remote

Cimpress Indiabhopal, madhya pradesh, in

Remote

NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago

Promoted
New!

Senior Data Engineer

Go Digit General Insurancebhopal, madhya pradesh, in

Designation : Senior Data Engineer.Digit’s mission is to ‘Make Insurance, Simple’.We are backed by Fairfax- one of the largest global investment firms. We have also been ranked as 'LinkedIn top 5 sta...Show moreLast updated: 13 hours ago

Promoted
New!

Senior Data Engineer

PRI Globalbhopal, madhya pradesh, in

Demonstrated ownership and accountability for end-to-end delivery.Applications / Software Developer 4.Strong sense of ownership and commitment to high-quality outcomes.Show moreLast updated: 12 hours ago

Promoted

Senior Data Integration Engineer

Indsafribhopal, madhya pradesh, in

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladebhopal, madhya pradesh, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Incept Labsbhopal, madhya pradesh, in

Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog Labsbhopal, madhya pradesh, in

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Straivebhopal, madhya pradesh, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted
New!

Senior Data Engineer

SII Group Indiabhopal, madhya pradesh, in

Databricks, GCP, and Data Pipeline Development.The ideal candidate will have a deep understanding of.Design, develop, and optimize scalable. Cloud Build, BigQuery, Firestore.Collaborate with cross-f...Show moreLast updated: 13 hours ago

Promoted

Senior Data Engineer

HealthyMe AIbhopal, madhya pradesh, in

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago

Promoted
New!

AWS Lead Data engineer

Tata Consultancy Servicesbhopal, madhya pradesh, in

In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 13 hours ago