Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAPShimoga, IN2 hours ago
Job descriptionDesign, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading. Develop custom Python-based data automation frameworks to improve quality and speed. Build and optimize SQL queries, tables, and database structures for analytics & AI use cases. Create and manage API-based data ingestion / integration workflows. Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools. Collaborate with product, AI, and analytics teams to deliver intelligent data solutions. Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines. Continuously optimize pipelines for performance, cost, scalability, and reliability. Bachelor’s or Master’s degree in Computer Science / Engineering / IT. Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development. Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster). Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents. Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows. Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
Senior Python Data Engineer – ETL & Pipeline Development
Experience : 5 to 12 Years
Location : Remote (WFH) / Bangalore / India
Mode of Engagement : Full-time
No. of Positions : 5
Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry : IT / Data / AI / LegalTech / Enterprise Solutions
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
- Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
- Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
- Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
- Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
- Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
- Experience building or working with AI-driven / automated data pipelines (preferred).
Responsibilities :
Qualifications :
Create a job alert for this search
Senior Data Engineer • Shimoga, IN
Related jobs
- Promoted
Senior Data Engineer
Intellify SolutionsShimoga, IN Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show moreLast updated: 10 days ago
- Promoted
Python Developer
Intelliasshimoga, karnataka, in Your mission? Help millions of pet lovers find the perfect products—without building yet another monolith that cries in staging.
You'll work with product owners, architects, and developers who’ve sw...Show moreLast updated: 19 days ago
- Promoted
Senior Python Data Engineer
iVoyantdavanagere, karnataka, in Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 6 days ago
- Promoted
Senior Python Developer (Programming)
Jobseekerspage.comdavanagere, karnataka, in HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show moreLast updated: 3 days ago
- Promoted
Senior Python Developer
Aarav Solutionsshimoga, karnataka, in Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
K&K Talentsdavangere, karnataka, in This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai.
Tableau | ETL / ELT | SQL | Python | Snow...Show moreLast updated: 4 hours ago
- Promoted
Senior Data Engineer
SGS & Codavanagere, karnataka, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 19 days ago
- Promoted
AWS Data Engineer
Vista Applied Solutions Group IncDavanagere, IN Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 5 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicesdavangere, karnataka, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 27 days ago
- Promoted
- New!
Senior Python / FastAPI Development Lead
MindBraindavangere, karnataka, in Python / FastAPI Development Lead.Python), 3+ years (FastAPI), 4+ years (Team Leadership).We are looking for a Python / FastAPI Development Lead to design, develop, and maintain high-quality backend ...Show moreLast updated: less than 1 hour ago
- Promoted
Data Engineer
IntraEdgeShimoga, IN We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Live Connectionsshimoga, karnataka, in Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
- Promoted
ETL & Tableau Data Engineer
Magma ConsultancyShimoga, IN ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
IntelliasDavanagere, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 19 days ago
- Promoted
- New!
Senior Python - FastAPI Development Lead (8+ Years)
MindBraindavangere, karnataka, in Hiring : Python / FastAPI Development Lead.Remote | 🧑💻 8+ Years Experience | ⏳ Duration : 2 Months (Extendable).Python / FastAPI Development Lead.
The ideal candidate will own the full API lifecycle—...Show moreLast updated: less than 1 hour ago
- Promoted
Data Engineer
AceolutionDavanagere, IN Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
- Promoted
Python Software Engineer
Teamware Solutionsshimoga, karnataka, in Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt Ltd.Role : Python Software Engineer - IC.Location : Bangalore / Hyderabad / pune / Mumbai.
Shift : (Flexibility Required) / ...Show moreLast updated: 1 day ago
- Promoted
Platform Engineer – Python / Databricks / Notebooks / Kubernetes
SyntasaShimoga, IN Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show moreLast updated: 29 days ago