Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • vapi, gujarat, in

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • vapi, gujarat, in

7 hours ago

Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.

Develop custom Python-based data automation frameworks to improve quality and speed.

Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.

Create and manage API-based data ingestion / integration workflows.

Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.

Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.

Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.

Continuously optimize pipelines for performance, cost, scalability, and reliability.

Qualifications :

Bachelor’s or Master’s degree in Computer Science / Engineering / IT.

Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.

Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).

Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.

Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.

Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

Create a job alert for this search

Senior Data Engineer • vapi, gujarat, in

Related jobs

Python Software Engineer

Teamware Solutions • vapi, gujarat, in

Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai. Shift : (Flexibility Required) / ...Show more

Last updated: 1 day ago • Promoted

AWS Data Engineer

Tata Consultancy Services • vapi, gujarat, in

TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more

Last updated: 28 days ago • Promoted

Meril Life - AI Technical Lead

MERIL LIFE SCIENCES PRIVATE LIMITED • Vapi

Description : - 7+ years of deep AI / ML engineering experience with at least 3+ years leading technical teams.Strong expertise in computational chem...Show more

Last updated: 18 hours ago • Promoted • New!

Senior Azure Data Engineer

Tata Consultancy Services • Vapi, Gujarat, India

Greetings from TCS! Job Title : Senior Data Engineer (Azure / SSIS) Location : PAN INDIA Experience Range : 7-14 years.Required Skillset : Minimum 6 yrs of experience in building ETL pipeline using Az...Show more

Last updated: 3 days ago • Promoted

Databricks Engineer

TTC Group • Vapi, Gujarat, India

Role : Databricks Engineer Position : Remote Type : Contract Duration : 3 - 6 months (extendable) Role Overview We are seeking a Mid-Level Databricks Engineer with strong data engineering fundame...Show more

Last updated: 3 days ago • Promoted

Senior Python Data Engineer

iVoyant • vapi, gujarat, in

Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more

Last updated: 6 days ago • Promoted

Python Developer

Tata Consultancy Services • vapi, gujarat, in

Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Meril • Vapi, Gujarat, India

Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You’ll work with diverse data types and modern data platforms to desi...Show more

Last updated: 17 days ago • Promoted

Senior Python / FastAPI Development Lead

MindBrain • vapi, gujarat, in

Python / FastAPI Development Lead.Python), 3+ years (FastAPI), 4+ years (Team Leadership).We are looking for a Python / FastAPI Development Lead to design, develop, and maintain high-quality backend ...Show more

Last updated: 7 hours ago • Promoted • New!

ETL & Tableau Data Engineer

Magma Consultancy • vapi, gujarat, in

ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more

Last updated: 3 days ago • Promoted

Senior Python Developer (Programming)

Jobseekerspage.com • vapi, gujarat, in

HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more

Last updated: 3 days ago • Promoted

Senior Data Engineer

K&K Talents • vapi, gujarat, in

Last updated: 11 hours ago • Promoted • New!

Python Developer

MyData Insights Pvt Ltd • vapi, gujarat, in

We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, col...Show more

Last updated: 4 days ago • Promoted

Senior Python Developer

Aarav Solutions • Vapi, Gujarat, India

Company Description Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our d...Show more

Last updated: 30+ days ago • Promoted

Senior Python - FastAPI Development Lead (8+ Years)

MindBrain • vapi, gujarat, in

Hiring : Python / FastAPI Development Lead.Remote | 🧑‍💻 8+ Years Experience | ⏳ Duration : 2 Months (Extendable).Python / FastAPI Development Lead. The ideal candidate will own the full API lifecycle—...Show more

Last updated: 7 hours ago • Promoted • New!

Senior Data Engineer

Live Connections • vapi, gujarat, in

Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more

Last updated: 30+ days ago • Promoted

Python Developer

GoML • vapi, gujarat, in

We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more

Last updated: 4 days ago • Promoted

Data Engineer

Confidential • Vapi, India

Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You'll work with diverse data types and modern data platforms to desi...Show more

Last updated: 17 days ago • Promoted