This job offer is not available in your country.

Data Engineer - ETL / PySpark

Varite IndiaBangalore

30+ days ago

Job description

We are looking for an experienced Data Engineer with strong hands-on experience in AWS data services to support data transformation and migration initiatives.

The ideal candidate will play a key role in designing and implementing robust data pipelines, migrating on-premise data to AWS, and enabling data availability for analytics and business intelligence use cases.

Key Responsibilities :

Design, develop, and maintain data pipelines and ETL workflows for structured and unstructured data

using AWS Glue and other AWS data tools.

Execute data transformation processes and data flow design for migrating control and activity data to

AWS cloud infrastructure.

Work with AWS DMS (Database Migration Service) for seamless data replication from on-premise databases to AWS services.

Utilize AWS DataSync for automating and accelerating data transfer between on-prem and cloud storage environments.

Collaborate with data architects, cloud engineers, and business stakeholders to understand data requirements and deliver high-quality solutions.

Ensure data integrity, security, and governance throughout the data migration and processing lifecycle.

Monitor and optimize ETL job performance and troubleshoot issues in large-scale data environments.

Support data validation, quality checks, and reconciliation post-migration.

Stay up-to-date with AWS data service offerings, best practices, and tools to continuously improve data Skills & Experience :

6+ years of experience in Data Engineering with strong focus on AWS Cloud technologies.

Hands-on experience with AWS Glue for building and managing scalable ETL jobs.

Experience with AWS DMS for real-time and batch database migration and replication.

Proficiency with AWS DataSync for large-scale data transfer from on-prem to cloud environments.

Strong SQL skills and experience working with both relational and non-relational databases.

Understanding of data transformation, data warehousing, and cloud data architecture principles.

Familiarity with S3, Redshift, RDS, and other AWS storage and compute services.

Experience with data validation, quality assurance, and monitoring techniques.

Strong analytical, problem-solving, and communication Qualifications :

AWS certifications.

Experience with Python or PySpark for scripting and transformation in AWS Glue.

Prior experience working in Agile environments and using tools like Jira and Git.

Exposure to data governance tools and frameworks

ref : hirist.tech)

Create a job alert for this search

Data Engineer • Bangalore

Related jobs

Promoted

Inxite Out - Azure Data Engineer - PySpark / ETL

INXITE-OUT PRIVATE LIMITEDBangalore

Role : DATA ENGINEER : - Design, develop, and maintain scalable data pipelines using Python and PySpark.Implement and manage data workflows within ...Show moreLast updated: 24 days ago

Data ETL Engineer

IDTBangalore, Other, ,

Quick Apply

This is a full-time work from home opportunity for a star BI data engineer from India.Today it is an industry leader in prepaid communication and payment services and one of the world’s largest int...Show moreLast updated: 26 days ago

Promoted

Data Engineer - PySpark / Hadoop

TalentBasketBangalore

Job Title : Data Engineer (PySpark) Experience : 4+ Years Location : ENBD Bangalore Offi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer – ETL

Demand AIBengaluru, IN

ETL development and data engineering.Looking for a Data Engineer specializing in ETL processes to design and implement data pipelines that support data integration and analytics initiatives.Design,...Show moreLast updated: 21 days ago

Promoted

Data Engineer - Typescript / Pyspark

NP GroupBangalore, IN

Data Engineer - Python, Pyspark & Typescript.Rate : $20 - $25 per hour ($3,000 - $4,000 per month).We have an immediate requirement for an experienced Data Engineer to join the global engineering te...Show moreLast updated: 10 days ago

Promoted

Data Engineer - Python / PySpark

DashhireBangalore

Responsibilities : - Design, develop, and optimize ETL pipelines using Azure Data Factory (ADF).Build and manage data lakes and data warehouses usi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - ETL / PySpark

Pan Asia HR SolutionsBangalore

Job Title : PySpark ETL Developer Location : Bengaluru (On-site / Hybrid based on project requirements) Experience : <...Show moreLast updated: 26 days ago

Promoted

AWS Data Engineer - ETL / PySpark / Python

ChangeleadersBangalore

Position : AWS Data Engineer Experience : 5+ Yrs Location : Bangalore, Hyderabad, Chennai, Pune, Gurgaon <...Show moreLast updated: 15 days ago

Promoted

Data Engineer - ETL

First Phoenics SolutionsBangalore

Job Title : Data Engineer Location : Hyderabad / Bengaluru Experience : <...Show moreLast updated: 1 day ago

Promoted

Data Engineer - Python / PySpark

Akira Consultancy Pvt. Ltd.Bangalore

Job Description : Data Engineer Location : Bengaluru Experience : 3 - 5 years About the Role : We are seeking a h...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - ETL

GetHyrBangalore

Location : Bangalore JD Title : Data : - Create prototypes and proof-of-concepts for iterative development....Show moreLast updated: 19 days ago

Promoted
New!

Data Engineer - ETL

Jobtravia Pvt. Ltd.Bangalore

Job Title : Data Integration Engineer / ETL Developer IICS + Python + AWS Experience : 58 Years ...Show moreLast updated: less than 1 hour ago

Promoted

SQL Developer - ETL / PySpark

DeqodeBangalore

Were looking for a talented SQL + ETL Developer to join our dynamic team, someone whos passionate about turning raw data into actionable insights. If you love crafting efficient queries, building ro...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - Python / PySpark

Tiyasha Software Private Limited.Bangalore

Job Title : Data Engineer (Contract-to-Hire) Experience Level : 6 to 10 Years Location : Hybrid - 3 Days Onsite (Pune, Bangalore, Noida, Mumbai, Hyderabad)...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - ETL

Microgreen Technologies Pvt. LtdBangalore

Data Engineer (ETL Specialist) Location : Bangalore (Local Candidates Only) Experience : 5 - 7 YearsShow moreLast updated: 5 days ago

Promoted

Senior Data Engineer - ETL / PySpark

Renovision Automation Services Pvt.Ltd.Bangalore

Essential Duties and Responsibilities : - This section contains a list of five to eight primary responsibilities of this role th...Show moreLast updated: 19 days ago

Promoted

Pyspark Developer

Tata Consultancy ServicesBengaluru, Karnataka, India

Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI / CD. Chennai / Pune / Bangalore / Hyderabad / Trivandrum / Kochi.Data Enginee...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - ETL / PySpark

Axim DigitechBangalore

Key Skill : Pyspark, Cloudera Data Platfrorm, Big data Hadoop, Hive, Kafka Responsibilities : <...Show moreLast updated: 17 days ago