Senior Scala Developer_Mumbai

Role-Senior Scala DeveloperExperience-7-14 YearsLocation-Mumbai (Powai)Skills- Scala, Spark, UNIXMinimum 5+ years of experience in development of Spark ScalaExperience in designing and development of solutions for Big Data using Hadoop ecosystem technologies such as with Hadoop Bigdata components like HDFS, Spark, Hive Parquet File format, YARN, MapReduce, SqoopGood Experience in writing and optimizing Spark Jobs, Spark SQL etc. Should have worked on both batch and streaming data processing.Experience in writing and optimizing complex Hive and SQL queries to process huge data. good with UDFs, tables, joins, Views etcExperience in debugging the Spark codeWorking knowledge of basic UNIX commands and shell scriptExperience of Autosys, GradleGood-to-HaveGood analytical and debugging skillsAbility to coordinate with SMEs, stakeholders, manage timelines, escalation & provide on time statusWrite clear and precise documentation / specificationWork in an agile environmentCreate documentation and document all developed mappingsResponsibility of / Expectations from the RoleCreate Scala / Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelines