Talent.com
Data Engineer
Data EngineerIntraEdge • Prayagraj(Allahabad), IN
Data Engineer

Data Engineer

IntraEdge • Prayagraj(Allahabad), IN
30+ days ago
Job description

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency. This role requires a deep understanding of data modeling, ETL frameworks, and cloud-based data platforms.

Job Title : Data Engineer

Location : Remote

Full-Time

Responsibilities :

Design, develop, and maintain scalable ETL / ELT pipelines using PySpark and AWS Glue.

Build and optimize data models in Snowflake to support reporting, analytics, and machine learning workloads.

Automate data ingestion from various sources including APIs, databases, and third-party platforms.

Esure high data quality and implement data validation and monitoring processes.

Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high-quality solutions.

Work with large datasets in structured and semi-structured formats (JSON, Parquet, Avro, etc.).

Participate in code reviews, performance tuning, and debugging of data workflows.

Implement security and compliance measures across data pipelines and storage.

Required Skills :

5+ years of experience as a Data Engineer or similar role.

Proficiency in Python for data manipulation and scripting.

Experience with PySpark for large-scale data processing.

Strong expertise in Snowflake – data modeling, performance tuning, and SnowSQL.

Experience with AWS Glue, including Glue Jobs, Crawlers, and Data Catalog integration.

Experience with other AWS services like S3, Lambda, Athena, CloudWatch, etc.

Familiarity with CI / CD pipelines and version control tools (e.g., Git).

Understanding of data warehousing concepts, dimensional modeling, and ETL best practices.

Problem-solving skills and attention to detail.

Must have skills : Python

PySpark

AWS

AWS Glue

Lambda

S3

Snowflake

Redshift

SQL

DBT

Create a job alert for this search

Data Engineer • Prayagraj(Allahabad), IN

Related jobs
Customer Engineer (Data Engineer)

Customer Engineer (Data Engineer)

Konecta • Prayagraj(Allahabad), IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 3 days ago • Promoted
Data Engineer

Data Engineer

Vriba Solutions • Prayagraj(Allahabad), IN
Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Recro • Prayagraj(Allahabad), IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

BAE Systems • AU
Opportunity to work on enterprise-wide data and integration platforms.Collaboration with cross-functional teams in a modern data-driven environment. Career development and learning pathways in cloud...Show more
Last updated: 7 days ago
Senior Data Engineer

Senior Data Engineer

Professional Search Group • AU
PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia. With a rapidly growing customer base ...Show more
Last updated: 30+ days ago
Senior Data Engineer

Senior Data Engineer

RapidBrains • Prayagraj(Allahabad), IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 13 days ago • Promoted
•AWS Data Engineer •

•AWS Data Engineer •

Accenture • AU
Combine the best of your ingenuity and Cloud technologies to build a better world and manage clients towards change.Join us and do extraordinary things. Accenture is a global professional services c...Show more
Last updated: 30+ days ago
Data Engineer

Data Engineer

Bookipi • AU
We’re seeking an experienced and versatile Data Engineer with technical skills in data structuring, warehousing, data retrieval, visualisation and presentation. You will work alongside our developer...Show more
Last updated: 30+ days ago
Data Engineer

Data Engineer

Randstad Enterprise • Prayagraj(Allahabad), IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

Tata Consultancy Services • Prayagraj(Allahabad), IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Databricks Engineer

Databricks Engineer

Accenture • AU
Databricks Data Engineer Consultant.You’ll work on cutting-edge cloud and hybrid data projects, developing scalable pipelines and transforming raw data into meaningful insights.You’ll be hands-on f...Show more
Last updated: 30+ days ago
Principal Cloud Data Engineer

Principal Cloud Data Engineer

Centorrino Technologies • AU
Remote
Quick Apply
Join Centorrino Technologies : Innovate, Grow, and Thrive with Us!.At Centorrino Technologies (CT), we’re more than just tech—we’re a community that goes beyond expectations.We’ve been recognised as...Show more
Last updated: 30+ days ago
Data Engineer

Data Engineer

Insight Global • Prayagraj(Allahabad), IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Data Engineer

Data Engineer

BayOne Solutions • Prayagraj(Allahabad), IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 30+ days ago • Promoted
Data Engineer (GCP)

Data Engineer (GCP)

HISH IT SERVICES • Prayagraj(Allahabad), IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 14 days ago • Promoted
Senior Data Engineer

Senior Data Engineer

Mindlance • Prayagraj(Allahabad), IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 6 days ago • Promoted
Data Engineer

Data Engineer

National Heart Foundation Of Australia • AU
A rewarding opportunity to make a real impact on heart health.Flexible hybrid working arrangements from any capital city office. Permanent full-time role | NFP salary packaging perks .About Us – Hav...Show more
Last updated: 3 days ago
Data Engineer - Palantir Foundry

Data Engineer - Palantir Foundry

NP Group • Prayagraj(Allahabad), IN
Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
Last updated: 30+ days ago • Promoted