Senior AWS Data Engineer

CYAN360mangalore, karnataka, in

30+ days ago

Job description

Position : Senior AWS Data Engineer

Location : Remote

Salary : Open

Work Timings : 2 : 30 PM to 11 : 30 PM IST

Need someone who can join immediately or in 15 days

Responsibilities :

Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.

Implement data processing and transformation workflows using Apache Spark, and SQL to support analytics and reporting requirements.

Build and maintain orchestration workflows to automate data pipeline execution, scheduling, and monitoring.

Collaborate with analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.

Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.

Qualification :

Minimum 8+ years of experience building and deploying large-scale data processing pipelines in a production environment.

Hands-on experience in designing and building data pipelines on AWS cloud infrastructure.

Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.

Strong experience with Apache Spark for data processing and analytics.

Hands-on experience on orchestrating and scheduling data pipelines using AppFlow, Event Bridge and Lambda.

Solid understanding of data modeling, database design principles, and SQL and Spark SQL.

Create a job alert for this search

Aws Data Engineer • mangalore, karnataka, in

Related jobs

Promoted

Senior Data Engineer

SAIVA AIMangalore, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Senior AWS Data Engineer

CYAN360Mangalore, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPMangalore, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Senior Azure Data Engineer (8+ Yrs)

Delphi Consulting Middle EastMangalore, IN

Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer (AWS / Databricks)

Accolademangalore, karnataka, in

The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 22 days ago

Promoted

Data Engineer(Azure / AWS, Python / Pyspark, SQL)

Sail Analyticsmangalore, karnataka, in

Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 20 days ago

Promoted

Data Engineer

VeraxionMangalore, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago

Promoted

AWS Data Engineer

TerraGiGMangalore, IN

Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Nityo InfotechMangalore, IN

Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Saras Analyticsmangalore, karnataka, in

We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Manuh TechnologiesMangalore, IN

Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

AIQUMangalore, IN

We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago

Promoted

Senior AWS Administrator

CYAN360Mangalore, IN

Job title : AWS Infrastructure Engineer.ETL / ELT processes using AWS services such as AWS Glue, AWS Lambda and AWS Step Functions. Ensure data quality, security, and compliance with industry best prac...Show moreLast updated: 3 days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsMangalore, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

HealthyMe AIMangalore, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 20 days ago

Promoted

Senior Azure Data Engineer

Programmers.iomangalore, karnataka, in

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago

Promoted

Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)

Sky Systems, Inc. (SkySys)Mangalore, IN

Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 1 day ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.Mangalore, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

Saransh Incmangalore, karnataka, in

Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 11 days ago

Promoted

Senior Data Engineer

USEReadymangalore, karnataka, in

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 22 days ago