5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

Candidates

ready to join immediately

can share their details via email for quick processing.

CCTC | ECTC | Notice Period | Location Preference

nitin.patil@ust.com

Act fast for immediate attention! ⏳

5+ years if Experienc

e.Roles and Responsibiliti

esDesign, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala

).Build data ingestion and transformation frameworks for structured and unstructured data source

s.Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solution

s.Work with large volumes of data and ensure quality, integrity, and consistenc

y.Optimize data workflows for performance, scalability, and cost efficiency on cloud platforms (AWS, Azure, or GCP

).Implement data quality checks and automation for ETL / ELT pipeline

s.Monitor and troubleshoot data issues in production and perform root cause analysi

s.Document technical processes, system designs, and operational procedure

s.Must-Have Skil

ls3+ years of experience as a Data Engineer or similar rol

e.Hands-on experience wit h PySpa rk o r Spark using Sca l

a.Strong knowledge o f S QL for data querying and transformatio

n.Experience working wit h any cloud platfo rm (AWS, Azure, or GCP

).Solid understanding of data warehousing concepts and big data architectur

e.Experience with version control systems like Gi

t.Good-to-Have Skil

lsExperience with data orchestration tools lik e Apache Airfl ow , Databricks Workflo ws, or simila

r.Knowledge o f Delta La ke , HD FS, o r Kaf k

a.Familiarity with containerization tools (Docker / Kubernetes

).Exposure to CI / CD practices and DevOps principle

s.Understanding of data governance, security, and compliance standard

s.