Job Title : Senior Scala Engineer
Job Location : Bengaluru
Exp Range : 6-10 years
Required Skills : Scala, Python ,
- Big Data Orchestration : Airflow, Spark on Kubernetes, Yarn, Oozie
- Big Data Processing : Hadoop, Kafka, Spark & Spark Structured Streaming.
- Experience on SOLID & DRY principles with Good Software Architecture & Design implementation experience
- Advanced Scala experience (e.g. Functional Programming, using Case classes, Complex Data Structures & Algorithms)
- Proficient in developing automated frameworks for unit & integration testing.
- Proficient with Kubernetes, Docker, Helm and related container technologies.
- Proficient in deploying and managing Spark workloads on Kubernetes clusters.
- Experience in evaluation and implementation of Data Validation & Data Quality
- Devops experience in Jenkins, Maven, Github, Github actions, CI / CD
- Expertise in data pipeline optimization and performance tuning