AWS Data Pipeline EngineerConfidential • Bengaluru / Bangalore
AWS Data Pipeline Engineer
Confidential • Bengaluru / Bangalore
6 days ago
Job description
Roles and Responsibility
Managing data storage solutions on AWS, including Amazon S3, Amazon Redshift, and Amazon DynamoDB.
Implementing and optimizing data processing workflows using AWS services like AWS Glue, Amazon EMR, and AWS Lambda.
Collaborating with Spotfire Engineers and business analysts to ensure data accessibility and usability for analysis and visualization.
Working with other engineers and business stakeholders to understand requirements and deliver solutions.
Writing code in languages like SQL, Python, or Scala to build and maintain data pipelines and applications.
Using Infrastructure as Code (IaC) tools to automate the deployment and management of data infrastructure.
Job Requirements
Strong understanding of core AWS services, cloud concepts, and the AWS Well-Architected Framework.
Experience with data pipeline design and development using AWS services.
Knowledge of SQL, Python, or Scala programming languages.
Familiarity with Infrastructure as Code (IaC) tools.
Understanding of data integration and workflow optimization techniques.
Ability to work closely with data engineers and other stakeholders to understand data requirements.
Skills Required
Aws Services, Data Modeling, Python Scripting, Cloudformation
Create a job alert for this search
Data Pipeline Engineer • Bengaluru / Bangalore
Related jobs
Data Engineer (AWS)
Sustainability Economics.ai • Bengaluru, India
AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show more
Last updated: less than 1 hour ago • Promoted • New!
Cloud Engineer (AWS, Azure)
BPMLinks • hosur, tamil nadu, in
Job Description – Cloud Engineer (AWS, Azure, Snowflake) : .We are looking for a skilled Cloud Engineer to take ownership of the existing multi-cloud infrastructure and data integration setup.Manage ...Show more
Last updated: 14 days ago • Promoted
AWS Data Engineer
Atyeti Inc • Bengaluru, Karnataka, India
Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform.
Roles and Responsibility : - Build and main...Show more
Last updated: 1 day ago • Promoted
Senior AWS Data Engineer
CYAN360 • Bangalore, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
Last updated: 30+ days ago • Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Inc • hosur, tamil nadu, in
Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
Last updated: 15 days ago • Promoted
Senior Python Data Engineer
iVoyant • hosur, tamil nadu, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 2 days ago • Promoted
Data Engineer with Databricks & GCP
iitjobs, Inc. • hosur, tamil nadu, in
Role : - Data Engineer with Databricks & GCP.Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark.
Expertise in SQL and advanced query optimization.Proficiency ...Show more
Last updated: 16 hours ago • Promoted • New!
Cloud Consultant
Mastek • hosur, tamil nadu, in
We need an experienced AWS Data Engineer / Performance Optimization Consultant to help us analyze, tune, and optimize our existing AWS Glue ETL, Step Functions workflows and Amazon Redshift data wa...Show more
Last updated: 15 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • hosur, tamil nadu, in
TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services).
Strong expertise in Azure Data Engineering & ETL Co...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer (PySpark)
Atyeti Inc • Bengaluru, Karnataka, India
Proficient with Python, PySpark and Airflow.Strong understanding of Object-Oriented Programming and Functional Programming paradigm.
Must have experience working with Spark and its architecture.Know...Show more
Last updated: 18 hours ago • Promoted • New!
AWS Lead Data engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show more
Last updated: 13 days ago • Promoted
AWS Data Engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
TCS is Hiring AWS Data Engineer Bangalore location Experience : 6 - 10 years Mode of interview : Virtual Location : Bangalore JOB DESCRIPTION : Must have : - Strong hands-on experience in Python...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Adastra • hosur, tamil nadu, in
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 2 days ago • Promoted
GCP Data Engineer
Xsell Resources • hosur, tamil nadu, in
Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show more
Last updated: 14 days ago • Promoted
Data Engineer
LanceSoft, Inc. • hosur, tamil nadu, in
This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve vario...Show more
Last updated: 16 hours ago • Promoted • New!
AWS Analytics || 12+years || Bangalore
client of NeerInfo Solutions • Bengaluru, Karnataka, India
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing.Create data pipelines, ensure data quality, and implement ETL (extract, transf...Show more
Last updated: 18 hours ago • Promoted • New!
Data Engineer
Tata Consultancy Services • hosur, tamil nadu, in
Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show more
Last updated: 30+ days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • hosur, tamil nadu, in
Remote
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more