Big Data Lead

Job Title / Primary Skill :   Big Data Developer (Lead / Associate Manager)

Management Level : G150

Years of Experience :  8 to 13 years

Job Location :  Bangalore (Hybrid)

Must Have Skills :   Big data, Spark, Scala, SQL, Hadoop Ecosystem.

Educational Qualification :   BE / BTech / MTech / MCA, Bachelor or masters degree in Computer Science,

Job Overview

Overall Experience 8+ years in IT, Software Engineering or relevant discipline.

Designs, develops, implements, and updates software systems in accordance with the needs of the organization.

Evaluates, schedules, and resources development projects; investigates user needs; and documents, tests, and maintains computer programs.

We look for developers to have good knowledge of Scala programming skills and Knowledge of SQL

Technical Skills :

• Scala, Python ->

Scala is often used for Hadoop-based projects, while Python and Scala are choices for Apache Spark-based projects.

Knowledge of SQL (Structured Query Language) is important for querying and manipulating data

Shell scripts are used for batch processing of data, it can be used for scheduling the jobs and shell scripts are often used for deploying applications

Spark Scala allows you to write Spark applications using the Spark API in Scala

It allows to work with structured data using SQL-like queries and Data Frame APIs.

Skills Required

Hadoop Ecosystem, Scala, Spark, Big Data, Sql