Architect

Role : Spark Scala / Big data Architect

Years of experience : 12 - 16 years

Job Location : Pune / Bangalore

Notice : Immediate to 30 days

Job Description :

Important Location constraint Pune and Bangalore only

Must have minimum 1012 yrs of Spark Scala Handson experience PySpark experience only is not sufficient

Overall 8 years of experience in design development and support in Spark and performance optimization of HDFS clusters Should have experience in large scale implementations on any Cloud platform Experience in onprem is not preferred

Should have handson experiencing in analyzing designing and development of Spark batch job processing and Spark streaming Especially spark streaming is mandatory and indepth knowledge is expected

Extremely proficient in design develop debugging and performance tuning of Scala code

Should have strong knowledge of architecture concepts should be able to propose new ideas and convert concepts into projects

Should have very strong knowledge of all AWS components including EMR Manage data processing AWS S3 and EC2

Good understanding of Spring Core framework

Has hands on experience on Hadoop like HDFS HBase Hive and Mapreduce

Solid knowledge of Microservices and has worked in Cloud based large enterprise performance sensitive applications

Knowledge of underlying databases such as Postgre and Couchbase

Good knowledge of SQL Low level design coding unit test and functional test support

Implement the defined technical standards for software coding tools and platforms

Understand the application framework and architecture for the application and implement the same

Understand the functions interactions and dependencies among components within the application

Should be able to understand business requirements perform deep analysis do detailed effort estimation and present technical solutions to client

Should be able to ideate new work and provide proactive proposals

Resolve technical problems for junior team members and establish strong processes

Create and review HLD and LLD documentation

Work with the concerned stakeholders to create and support optimal development environment

Develop and review code to ensure adherence to defined standards

Should have led teams for solution delivery Responsive and highquality communication in a timely manner

Should have worked in onsite offshore model Ownership and proactiveness is well demonstrated Stakeholder management Collaboration with other workstreams leads and should have ability to articulate the impact of work

Should be able to groom and mentor junior team members and covert them to reliable engineers

Skills

Mandatory Skills : Apache Spark, Big Data Hadoop Ecosystem, Scala, SparkSQL