Data Engineer_P_29th Oct 25

Responsibilities :

Big Data Orchestration : Airflow, Spark on Kubernetes, Yarn, Oozie

Big Data Processing : Hadoop, Kafka, Spark & Spark Structured Streaming

Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience

Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms)

Proficient in developing automated frameworks for unit & integration testing

Proficient with Kubernetes, Docker, Helm and related container technologies

Proficient in deploying and managing Spark workloads on Kubernetes clusters

Candidates should have hands on experience in Spark and Scala at least 5+ years with good data engineering concepts