Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • thoothukudi, India
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • thoothukudi, India
1 day ago
Job descriptionDesign, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading. Develop custom Python-based data automation frameworks to improve quality and speed. Build and optimize SQL queries, tables, and database structures for analytics & AI use cases. Create and manage API-based data ingestion / integration workflows. Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools. Collaborate with product, AI, and analytics teams to deliver intelligent data solutions. Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines. Continuously optimize pipelines for performance, cost, scalability, and reliability. Bachelor’s or Master’s degree in Computer Science / Engineering / IT. Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development. Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster). Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents. Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows. Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
Senior Python Data Engineer – ETL & Pipeline Development
Experience : 5 to 12 Years
Location : Remote (WFH) / Bangalore / India
Mode of Engagement : Full-time
No. of Positions : 5
Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT
Industry : IT / Data / AI / LegalTech / Enterprise Solutions
Notice Period : Immediate Joiners Preferred
What We Are Looking For :
- 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
- Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
- Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
- Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
- Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
- Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
- Experience building or working with AI-driven / automated data pipelines (preferred).
Responsibilities :
Qualifications :
Create a job alert for this search
Senior Data Engineer • thoothukudi, India
Related jobs
Senior Data Engineer
Intellias • Thoothukudi, IN
Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show more
Last updated: 21 days ago • Promoted
PySpark Data Engineer
EXTRAGIG • Thoothukudi, IN
Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role.
Execute creative software and data solutions, including des...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
System Soft Technologies • Tirunelveli, Tamil Nadu, India
Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more
Last updated: 16 hours ago • Promoted • New!
Python Developer
MyData Insights Pvt Ltd • Thoothukudi, Tamil Nadu, India
We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project.
You will design, build, and optimize scalable APIs, col...Show more
Last updated: 5 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • thoothukudi, tamil nadu, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 22 hours ago • Promoted • New!
Data Engineer
Aceolution • Thoothukudi, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 30+ days ago • Promoted
Senior Python Developer (Programming)
Jobseekerspage.com • Thoothukudi, Republic Of India, IN
HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
Last updated: 4 days ago • Promoted
Senior Data Engineer
K&K Talents • Thoothukudi, Tamil Nadu, India
K&K Talents is an international recruiting agency that has been providing technical resources globally since 1993.This position is with one of our clients in India , who is actively hiring candi...Show more
Last updated: 1 day ago • Promoted
Senior AI Engineer
BeGig • Thoothukudi, Tamil Nadu, India
Job Role- AI Engineer Job Type- Contract Duration- 6 months Work mode- Onsite(Bangalore) Experience Required- 4+ years About the Role We are looking for an experienced AI Engineer with strong ex...Show more
Last updated: 16 hours ago • Promoted • New!
Senior Data Engineer
Live Connections • tirunelveli, tamil nadu, in
Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show more
Last updated: 30+ days ago • Promoted
Senior AI / ML Engineer
Luxoft • Thoothukudi, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 18 days ago • Promoted
Senior Data Engineer
Mindlance • Thoothukudi, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 5 days ago • Promoted
Senior Python Developer
Aarav Solutions • thoothukudi, tamil nadu, in
Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
Last updated: 30+ days ago • Promoted
Senior Python Developer
HISH IT SERVICES • tirunelveli, tamil nadu, in
Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
Last updated: 10 days ago • Promoted
Ai Engineer
BeGig • Tirunelveli, Republic Of India, IN
Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
Last updated: 7 days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • tirunelveli, tamil nadu, in
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 1 day ago • Promoted
Data Engineer
IntraEdge • Thoothukudi, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Intellify Solutions • Thoothukudi, IN
Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show more
Last updated: 12 days ago • Promoted