Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)AIMLEAP • Nellore, Republic Of India, IN

Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)

AIMLEAP • Nellore, Republic Of India, IN

22 hours ago

Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.

Develop custom Python-based data automation frameworks to improve quality and speed.

Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.

Create and manage API-based data ingestion / integration workflows.

Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.

Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.

Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.

Continuously optimize pipelines for performance, cost, scalability, and reliability.

Qualifications :

Bachelor’s or Master’s degree in Computer Science / Engineering / IT.

Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.

Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).

Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.

Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.

Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

Create a job alert for this search

Senior Data Engineer • Nellore, Republic Of India, IN

Related jobs

Platform Engineer – Python / Databricks / Notebooks / Kubernetes

Syntasa • Nellore, IN

Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show more

Last updated: 30+ days ago • Promoted

Senior AI / ML Engineer

Luxoft • Nellore, IN

Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more

Last updated: 17 days ago • Promoted

Python Lead developer

Cognizant • nellore, andhra pradesh, in

Should have 10+ years of Python development experience.Experience with popular Python frameworks such as Django, Flask or Pyramid. Knowledge of data science and machine learning concepts and tools.A...Show more

Last updated: 7 hours ago • Promoted • New!

Data Engineer

Aceolution • Nellore, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more

Last updated: 30+ days ago • Promoted

Big Data Developer (Hive, Pyspark)

Tata Consultancy Services • nellore, andhra pradesh, in

Big Data Developer (Hive, Pyspark).Years of Experience : 4 to 10 yrs.Date of Interview : 5th Nov, 2025.Mode of Interview : Virtual Drive(Cisco or Webex). Hands-on experience of Hadoop, Python, PySpark,...Show more

Last updated: 20 days ago • Promoted

Senior Data Engineer

Intellify Solutions • Nellore, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more

Last updated: 11 days ago • Promoted

AWS Data Engineer

People Prime Worldwide • nellore, andhra pradesh, in

Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more

Last updated: 7 hours ago • Promoted • New!

Senior Python Developer

Aarav Solutions • nellore, andhra pradesh, in

Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more

Last updated: 30+ days ago • Promoted

AI Engineer (Data Pipelines & RAG)

BeGig • Nellore, IN

Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer

Live Connections • Nellore, IN

Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Tata Consultancy Services • nellore, andhra pradesh, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more

Last updated: 29 days ago • Promoted

Data Engineer – AWS

Recruin • nellore, andhra pradesh, in

Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more

Last updated: 7 hours ago • Promoted • New!

Senior Data Engineer

K&K Talents • Nellore, IN

Last updated: 1 day ago • Promoted

Data Engineer

Persistent Systems • nellore, andhra pradesh, in

We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more

Last updated: 10 days ago • Promoted

Senior Snowflake Data Engineer

Luxoft • nellore, andhra pradesh, in

We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more

Last updated: 6 hours ago • Promoted • New!

Data Analytics Specialist with Python (mandatory)

Wynploy • nellore, andhra pradesh, in

Only for candidates who are Immediate joiners or have served notice period within 4 months.Are you passionate about data analytics and turning raw data into actionable insights? We are seeking an e...Show more

Last updated: 6 hours ago • Promoted • New!