Senior AWS Data Engineer

CYAN360chennai, tamil nadu, in

30+ days ago

Job description

Position : Senior AWS Data Engineer

Location : Remote

Salary : Open

Work Timings : 2 : 30 PM to 11 : 30 PM IST

Need someone who can join immediately or in 15 days

Responsibilities :

Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.

Implement data processing and transformation workflows using Apache Spark, and SQL to support analytics and reporting requirements.

Build and maintain orchestration workflows to automate data pipeline execution, scheduling, and monitoring.

Collaborate with analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.

Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.

Qualification :

Minimum 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.

Hands-on experience in designing and building data pipelines on AWS cloud infrastructure.

Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.

Strong experience with Apache Spark for data processing and analytics.

Hands-on experience on orchestrating and scheduling data pipelines using AppFlow, Event Bridge and Lambda.

Solid understanding of data modeling, database design principles, and SQL and Spark SQL.

Create a job alert for this search

Aws Data Engineer • chennai, tamil nadu, in

Related jobs

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticschennai, tamil nadu, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 19 days ago

Promoted

Azure Senior Data Engineer

Tata Consultancy ServicesChennai, India

We await your innovation at TCS : Hiring |Azure Senior Data Engineers|.Required Experience : 5-10 years.Data Pipeline Development : Design, build, and optimize scalable data pipelines using Azure Data...Show moreLast updated: 3 days ago

Promoted

Lead / Senior Data Engineer - ETL / AWS

ResourcetreeChennai

We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong kn...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Nityo InfotechChennai, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 1 day ago

Promoted

AWS Data Engineer

TerraGiGChennai, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago

Promoted

AWS Data Engineer (Pyspark)

Tata Consultancy ServicesChennai, Tamil Nadu, India

Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,Kolkata.AWS Lambda, Python, Boto3 ,Pyspark, Glue.Strong experience in Python to package, deploy and monitor data science apps.Knowledge in Pytho...Show moreLast updated: 21 days ago

Promoted

Senior Data Engineer

Saras Analyticschennai, tamil nadu, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

USEReadychennai, tamil nadu, in

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 21 days ago

Promoted

Accenture - AWS Data Engineer

Accenture OperationChennai

Management Level : 9- Consultant Location : Open Must-have skills : Data Engineering, AWS(mandate) Show moreLast updated: 30+ days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPChennai, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360Chennai, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Lead AWS Data Engineer (12+ Years)

TVS NextChennai, Tamil Nadu, India

You will model and mine the data to describe the system behavior and to predict future actions.Build and deploy the infrastructure for ingesting high-volume support data from consumer interactions,...Show moreLast updated: 11 days ago

Promoted

TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_Chennai

Tata Consultancy ServicesChennai, Tamil Nadu, India

Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing. Hadoop, Teradata Background, IaC[Cloud Fo...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer

PoshmarkChennai, India

Senior Software Engineer - Data Engineering.Big Data team is a central player in the Poshmark organization.Our goal is to democratize data, support exploding business, build data and ML pipelines t...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Manuh TechnologiesChennai, IN

Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer - Snowflake / AWS

ResourcetreeChennai

About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 17 days ago

Promoted

AWS Data engineer ( Only Chennai / Hyderabad and kolkata Location)- 6-8 Years

Tata Consultancy ServicesChennai, Tamil Nadu, India

Greetings from TATA Consultancy Services.Pls find the Job Description below.Hands-on experience in Pyspark, Glue.Experience on EMR, S3, IAM, Lambda, Cloud formation, Python.AMI Rehydration, Python,...Show moreLast updated: 26 days ago

Promoted

Senior Data Engineer

SAIVA AIChennai, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accoladechennai, tamil nadu, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 21 days ago

Promoted

Lead Data Engineer - AWS Redshift

Resource Tree Global ServicesChennai

Job Name : Lead Data Engineer - AWS RedShift Years of Experience : 8 Job Description : Show moreLast updated: 17 days ago