Data EngineerStaffingine LLC • Prayagraj(Allahabad), IN

Data Engineer

Staffingine LLC • Prayagraj(Allahabad), IN

4 hours ago

Job description

Data Engineer

India, Remote

Full Time / Contract

# of Positions - 3

Job Summary

The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL / ELT processes, and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB. The ideal candidate will excel in building serverless data architectures, designing efficient data models, and ensuring robust pipeline performance through monitoring and optimization. The position is remote within India and open for both full-time and contract engagements.

Key Skills

Data Engineering & Pipelines

ETL / ELT pipeline development using Python
Data extraction, transformation, and loading into data lakes / warehouses
Workflow orchestration and automation
Real-time and batch data processing

AWS Cloud Expertise

S3, Glue, Lambda, Redshift, Aurora

Kinesis (real-time streaming)

DynamoDB (NoSQL databases)

AWS serverless architecture design

Integration of AWS managed services for data workflows

Serverless & Automation

Building event-driven pipelines using AWS Lambda

Serverless compute optimization

Automated triggering and orchestration of data processes

Data Modeling

Designing schemas for relational databases (OLTP / OLAP)

NoSQL data modeling and storage optimization

Understanding of normalization, partitioning, indexing

Monitoring & Optimization

AWS monitoring tools (CloudWatch, CloudTrail)

Pipeline performance tuning

Cost optimization across cloud resources

Collaboration & Communication

Cross-functional collaboration with analysts, data scientists, and engineering teams

Strong problem-solving, documentation, and communication skills

Minimum Qualifications

Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field (preferred).

Strong hands-on experience with Python for data engineering tasks.

Deep understanding of AWS cloud services used for data storage, streaming, ETL, and serverless compute.

Experience designing and implementing ETL / ELT pipelines .

Solid understanding of relational and NoSQL data modeling concepts.

Professional Experience Requirements

Proven experience building scalable data pipelines using Python.

Experience extracting and transforming data from diverse sources into cloud-based environments.

Hands-on experience with AWS services such as S3, Glue ETL, Lambda, Redshift / Aurora, Kinesis, and DynamoDB.

Demonstrated ability to design and implement serverless architectures.

Experience creating event-driven workflows using Lambda and other AWS triggers.

Strong experience in monitoring, debugging, and optimizing cloud-based data workflows.

Experience collaborating across data science, analytics, and engineering teams to deliver complete data solutions.

Create a job alert for this search

Data Engineer • Prayagraj(Allahabad), IN

Related jobs

Customer Engineer (Data Engineer)

Konecta • Prayagraj(Allahabad), IN

In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more

Last updated: 4 days ago • Promoted

Data Engineer

Vriba Solutions • Prayagraj(Allahabad), IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Recro • Prayagraj(Allahabad), IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

BAE Systems • AU

Opportunity to work on enterprise-wide data and integration platforms.Collaboration with cross-functional teams in a modern data-driven environment. Career development and learning pathways in cloud...Show more

Last updated: 8 days ago

Senior Data Engineer

Professional Search Group • AU

PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia. With a rapidly growing customer base ...Show more

Last updated: 30+ days ago

Senior Data Engineer

RapidBrains • Prayagraj(Allahabad), IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more

Last updated: 14 days ago • Promoted

•AWS Data Engineer •

Accenture • AU

Combine the best of your ingenuity and Cloud technologies to build a better world and manage clients towards change.Join us and do extraordinary things. Accenture is a global professional services c...Show more

Last updated: 30+ days ago

Data Engineer

Bookipi • AU

We’re seeking an experienced and versatile Data Engineer with technical skills in data structuring, warehousing, data retrieval, visualisation and presentation. You will work alongside our developer...Show more

Last updated: 30+ days ago

Data Engineer

Randstad Enterprise • Prayagraj(Allahabad), IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

IntraEdge • Prayagraj(Allahabad), IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Tata Consultancy Services • Prayagraj(Allahabad), IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more

Last updated: 30+ days ago • Promoted

Databricks Engineer

Accenture • AU

Databricks Data Engineer Consultant.You’ll work on cutting-edge cloud and hybrid data projects, developing scalable pipelines and transforming raw data into meaningful insights.You’ll be hands-on f...Show more

Last updated: 30+ days ago

Principal Cloud Data Engineer

Centorrino Technologies • AU

Remote

Quick Apply

Join Centorrino Technologies : Innovate, Grow, and Thrive with Us!.At Centorrino Technologies (CT), we’re more than just tech—we’re a community that goes beyond expectations.We’ve been recognised as...Show more

Last updated: 30+ days ago

Data Engineer

Insight Global • Prayagraj(Allahabad), IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

BayOne Solutions • Prayagraj(Allahabad), IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more

Last updated: 30+ days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Prayagraj(Allahabad), IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 15 days ago • Promoted

Data Engineer

National Heart Foundation Of Australia • AU

A rewarding opportunity to make a real impact on heart health.Flexible hybrid working arrangements from any capital city office. Permanent full-time role | NFP salary packaging perks .About Us – Hav...Show more

Last updated: 4 days ago

Data Engineer - Palantir Foundry

NP Group • Prayagraj(Allahabad), IN

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more

Last updated: 30+ days ago • Promoted