Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

AIMLEAPbangalore district, karnataka, in

1 day ago

Job description

Senior Data Engineer – ETL & Pipeline Development

Experience : 7 to 12 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 2

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.
Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).
Solid experience in writing complex SQL queries , optimizing database performance, and designing schemas for large-scale systems.
Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.
Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).
Practical exposure to Docker, Kubernetes , and CI / CD pipelines for automating and deploying ETL and data workloads.
Familiarity with AI-driven data pipelines or automation workflows is an added advantage.

Responsibilities :

Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.

Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.

Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.

Develop and integrate API-based data ingestion systems (internal and external).

Deploy and manage workloads using Docker, Kubernetes, and CI / CD tools ensuring high availability and version control.

Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions .

Implement data validation, monitoring, and alerting mechanisms for production pipelines.

Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.

Qualifications :

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

Proficiency in Python (FastAPI, Flask, or Django) , SQL , and REST API design .

Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).

Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP / Azure components.

Hands-on exposure to Docker, Kubernetes , and Git-based CI / CD workflows.

Excellent problem-solving, debugging, and analytical skills with an ownership mindset .

Create a job alert for this search

Senior Data Engineer • bangalore district, karnataka, in

Related jobs

Promoted

Senior Data Engineer

Straivehosur, tamil nadu, in

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticshosur, tamil nadu, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago

Promoted

Senior Data Pipeline Engineer

AppsForBharatBengaluru, Republic Of India, IN

We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show moreLast updated: 2 days ago

Promoted

ETL & Data Pipeline Engineer

Tata Consultancy ServicesBengaluru, Republic Of India, IN

TCS is having In-person for skill set Data Engineer (Snowflake developer )At Banglore Location on 11th Oct 25(Saturday).TCS Bangalore ,Global Axis H blockGopalan Global Axis Block-H, Rd Number 9, o...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladehosur, tamil nadu, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

AIMLEAPHosur, Tamil Nadu, India

Senior Data Engineer – ETL & Pipeline Development Experience : .Remote (Work from Home) / Bangalore / India Mode of Engagement : . Tech / MCA / Computer Science / IT Industry : .IT / Data / AI / LegalTech...Show moreLast updated: 1 day ago

Promoted

Backend and Data Pipeline Engineer

JRD Systemshosur, tamil nadu, in

Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago

Promoted

AWS Data Engineer

Tata Consultancy Serviceshosur, tamil nadu, in

TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 10 days ago

Promoted

Senior Data Engineer

Sonata SoftwareBengaluru, Karnataka, India

Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB. Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 21 days ago

Promoted

Senior Data Engineer

SAIVA AIhosur, tamil nadu, in

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Integration Engineer

Indsafrihosur, tamil nadu, in

Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 22 days ago

Promoted

Data Engineer

Veraxionhosur, tamil nadu, in

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer - Python - TDD - XP Practices

CareerXperts Consultingbangalore, karnataka, in

This role focuses on delivering robust, data-driven solutions using modern agile technical practices — including Continuous Integration & Deployment (CI / CD), Test-Driven Development (TDD), and Extr...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Mastekhosur, tamil nadu, in

We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.hosur, tamil nadu, in

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 15 days ago

Promoted

Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

AIMLEAPBengaluru, IN

Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 2 days ago

Promoted

ETL Data Engineer - Senior Analyst [T500-21006]

MUFGbangalore, karnataka, in

Japan’s premier bank, with a global network spanning in more than 40 markets.Outside of Japan, the bank offers an extensive scope of commercial and investment banking products and services to busin...Show moreLast updated: 14 days ago

Promoted

Data Engineer

Response Informaticshosur, tamil nadu, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago