Data Engineer

WhiteLotus Talent PartnersPrayagraj(Allahabad), IN

13 hours ago

Job description

Job Title- Azure Data Engineer Pyspark

Location- Whitefield / Domlur Embassy Park , Bangalore

Mode- Onsite

Job Type : Full-Time

Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations
Minimum 3 years of Python development experience
Minimum 2 years of experience in Azure Databricks, Azure Databases

Required Skills : PySpark, Databricks, Azure ADLS, Experience in working with Azure cloud, Delta Lake, SQL

Candidate must have 3 years of hand on experience in above skills

Candidate must have good communication, which need to be accessed by sharing problem scenarios and his solutioning skills

pyspark hands on complex transformations and important concepts

Transformations, aggregations, window functions

file formats and handling, schema handling, data handling, data type conversions

Delta Lake - versioning, recovering concepts

check coding skills with tricky programming scenarios / problems

Big Data handling, performance

complex sql problem

Create a job alert for this search

Data Engineer • Prayagraj(Allahabad), IN

Related jobs

Promoted

Data Engineer

RecroPrayagraj(Allahabad), IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

New!

Data Engineer

BAE SystemsAU

Opportunity to work on enterprise-wide data and integration platforms.Collaboration with cross-functional teams in a modern data-driven environment. Career development and learning pathways in cloud...Show moreLast updated: 14 hours ago

Senior Data Engineer

Professional Search GroupAU

PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia. With a rapidly growing customer base ...Show moreLast updated: 30+ days ago

Data Engineer

BethanieAU

Digital Enablement team to support the delivery of our data and systems integration requirements.Reporting to the Manager – Digital Enablement this is a permanent role available full-time or part-t...Show moreLast updated: 6 days ago

•AWS Data Engineer •

AccentureAU

Combine the best of your ingenuity and Cloud technologies to build a better world and manage clients towards change.Join us and do extraordinary things. Accenture is a global professional services c...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

AceolutionPrayagraj(Allahabad), IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Randstad EnterprisePrayagraj(Allahabad), IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Tata Consultancy ServicesPrayagraj(Allahabad), IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago

Databricks Engineer

AccentureAU

Databricks Data Engineer Consultant.You’ll work on cutting-edge cloud and hybrid data projects, developing scalable pipelines and transforming raw data into meaningful insights.You’ll be hands-on f...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgePrayagraj(Allahabad), IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalPrayagraj(Allahabad), IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

BayOne SolutionsPrayagraj(Allahabad), IN

We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago

Promoted

Data Engineer (GCP)

HISH IT SERVICESPrayagraj(Allahabad), IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 7 days ago

Lead Data Engineer - Infinite Consulting

Infinite ConsultingAU

Australian Citizens with current Baseline Clearance.Infinite Consulting is seeking.This is a July start for a 12 month initial contract – 2x6 months further extensions possible based on funding and...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

DigitalzonePrayagraj(Allahabad), IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago

Promoted

Data Engineer - Palantir Foundry

NP GroupPrayagraj(Allahabad), IN

Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show moreLast updated: 30+ days ago

Promoted

GCP Data Engineer

AdastraPrayagraj(Allahabad), IN

We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 2 days ago

Promoted

Google Looker Data Engineer

Insight GlobalPrayagraj(Allahabad), IN

We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show moreLast updated: 7 days ago