Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • pune, India

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • pune, India

3 days ago

Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.

Develop custom Python-based data automation frameworks to improve quality and speed.

Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.

Create and manage API-based data ingestion / integration workflows.

Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.

Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.

Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.

Continuously optimize pipelines for performance, cost, scalability, and reliability.

Qualifications :

Bachelor’s or Master’s degree in Computer Science / Engineering / IT.

Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.

Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).

Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.

Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.

Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

Create a job alert for this search

Senior Data Engineer • pune, India

Related jobs

Data Engineer

IntraEdge • Pune, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

RapidBrains • Pune, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more

Last updated: 14 days ago • Promoted

Lead / Senior Engineer - Python

TESTQ Technologies Limited • Pune

About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more

Last updated: 30+ days ago • Promoted

Big Data Engineer - ETL / Scala / Python

HyrEzy Talent Solutions • Pune

Role : Big Data Engineer About Organization : Our Client is an IT consulting organization focused on providing AI Led Digital Transforma...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer with Python and Snowflake - Pune

Capco • Pune, India

This job is with Capco, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Job Title : Senior ...Show more

Last updated: 12 hours ago • Promoted • New!

Senior Python / / AI Engineer

Luxoft • Pune, IN

Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more

Last updated: 2 days ago • Promoted

Senior Data Engineer

Persistent Systems • Pune, Maharashtra, India

Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more

Last updated: 30+ days ago • Promoted

Senior Python & Cloud Engineer - CI / CD Pipeline

Web Idea Solution LLP • Pune

Description : Job Title : Senior Python & Cloud Engineer Experience : 5-8 years &l...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Aceolution • Pune, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

vConstruct Private Limited • pune, maharashtra, in

Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - ETL / Python

TekIT Software Solutions Pvt. Ltd. • Pune

Description : Job Title : Data Engineer.Experience Required : 4+ Years.Job Description : We are looking fo...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

SAIVA AI • Pune, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more

Last updated: 30+ days ago • Promoted

Python Data Engineer

Synechron • Pune, Maharashtra, India

Job Title : Python Data Engineer Notice Period : Looking for immediate to 30 days' joiners Experience Required : 6+ Years Job Location : Pune (Hybrid Work Model) At Synechron, we believe in the po...Show more

Last updated: 30+ days ago • Promoted

AI Engineer (Data Pipelines & RAG)

BeGig • Pune, IN

Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more

Last updated: 10 days ago • Promoted

Senior Python Developer

Cactus Communications • Pune, Maharashtra, India

Overview You will be a part of Cactus Labs which is the R&D Cell of Cactus Communications.Cactus Labs is a high impact cell that works to solve complex technical and business problems that help kee...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer - ETL / Python

Confidential Company • Pune

Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in the data engineering ...Show more

Last updated: 30+ days ago • Promoted

Senior Python + AIML Engineer_Exp : 5+ Years

Atyeti Inc • Pune, Maharashtra, India

Job Title : AI Developer / Python Engineer with Prompt Engineering & Agentic Architecture Job Type : Full-Time Location : Pune, Kharadi Experience : 4+ Years Mode : Hybrid Required Skills Python Pr...Show more

Last updated: 13 days ago • Promoted

Coditas - Senior Data Engineer - Python

Coditas Technologies Pvt. Ltd. • Pune

Roles and Responsibilities : - Understand Business requirements and implement scalable solutions.Translate complex technical and functional requirements into detailed...Show more

Last updated: 30+ days ago • Promoted