Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • bangalore district, karnataka, in
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • bangalore district, karnataka, in
2 days ago
Job descriptionDesign, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading. Develop custom Python-based data automation frameworks to improve quality and speed. Build and optimize SQL queries, tables, and database structures for analytics & AI use cases. Create and manage API-based data ingestion / integration workflows. Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools. Collaborate with product, AI, and analytics teams to deliver intelligent data solutions. Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines. Continuously optimize pipelines for performance, cost, scalability, and reliability. Bachelor’s or Master’s degree in Computer Science / Engineering / IT. Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development. Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster). Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents. Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows. Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
Senior Python Data Engineer – ETL & Pipeline Development
Experience : 5 to 12 Years
Location : Remote (WFH) / Bangalore / India
Mode of Engagement : Full-time
No. of Positions : 5
Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry : IT / Data / AI / LegalTech / Enterprise Solutions
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
- Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
- Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
- Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
- Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
- Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
- Experience building or working with AI-driven / automated data pipelines (preferred).
Responsibilities :
Qualifications :
Create a job alert for this search
Senior Data Engineer • bangalore district, karnataka, in
Related jobs
Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR
CareerXperts Consulting • Bengaluru, Karnataka, India
About the job : Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.
A place where you are a polyglot, working alongside the client, enab...Show more
Last updated: 8 days ago • Promoted
Python Engineer (Airflow, Cloud)
Luxoft • bangalore, karnataka, in
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 2 hours ago • Promoted • New!
Senior Python Developer
HISH IT SERVICES • hosur, tamil nadu, in
Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
Last updated: 11 days ago • Promoted
Data Pipeline Engineer
Luxoft • Bengaluru, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 30+ days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • hosur, tamil nadu, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Delta Air Lines • Bengaluru, India
Design, architect, and optimize Teradata EDW solutions with a focus on performance, scalability, and maintainability.Lead performance tuning efforts using TASM and other workload management tools.D...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Intellias • Bangalore, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 21 days ago • Promoted
PySpark Data Engineer
EXTRAGIG • hosur, tamil nadu, in
Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role.
Execute creative software and data solutions, including des...Show more
Last updated: 30+ days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • Bangalore, IN
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Live Connections • hosur, tamil nadu, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Ubique Systems • bangalore, karnataka, in
Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
Last updated: 5 days ago • Promoted
Senior Data Engineer
Quantiphi • Greater Bengaluru Area, India
Job Title : Senior Data Engineer (Power BI).Location : Bangalore / Mumbai / Hybrid.We are seeking a skilled and proactive.
The ideal candidate will be responsible for designing, developing, and publish...Show more
Last updated: 30+ days ago • Promoted
Senior Python Developer
Rapid Innovation • hosur, tamil nadu, in
Job Title : Senior Python Developer (5–6 Years Experience).We are looking for an experienced Senior Python Developer who can design, build, and optimise scalable backend systems.You will work closel...Show more
Last updated: 2 hours ago • Promoted • New!
Senior Python Data Engineer
iVoyant • bangalore, karnataka, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 8 days ago • Promoted
Senior Python Developer (Programming)
Jobseekerspage.com • hosur, tamil nadu, in
HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
Last updated: 5 days ago • Promoted
Data Engineer (DOMO & Python / Kafka)
Smart Moves Consultants • hosur, tamil nadu, in
We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest.
Design, build, and maintain scala...Show more
Last updated: 2 hours ago • Promoted • New!
Python Data Engineer
Deloitte • Bengaluru, Karnataka, India
India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations ...Show more
Last updated: 10 days ago • Promoted
Data Engineer (Airflow, Azure)
Luxoft • Greater Bengaluru Area, India
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 6 hours ago • Promoted • New!