Spark / Scala Engineer

Job Role : Spark / Scala Engineer

Location : Bangalore

Experience : 6+ years

Type of Hire : Permanent

Technical Skills :

• 6 to 8 years of experience on application development with Spark / Scala
• Good hands-on experience of working on the Hadoop Eco-system ( HDFS, Hive, Spark )
• Good understanding of the Hadoop File Formats
• Good Expertise on REST API , SQL , GIT , Shell / Python Scripting.
• Expertise in the implementation of the Data Quality Controls
• Ability to interpret the Spark UI and identify the bottlenecks in the Spark process and provide the optimal solution.

Must Have Skills :

Spark Scala- Proficiency in coding and transforming raw requirements into technical solution.

Hadoop- Experience with HDFS infrastructure and platform. Proficiency in the HDFS commands

SQL- Strong skills in data analysis, including querying and data retrieval.

GitHub- Expertise in code management throughout the entire development lifecycle.

GOOD TO HAVE :

Hive- Familiarity with this tool for data viewing and computation.

SonarQube- Knowledge of code quality monitoring practices.

Shell Scripting / Python- Ability to utilize these languages to execute Spark Scala code within a big data environment.