Spark & Scala Developer

Job Description :

• Formal training or certification in software engineering concepts with at least 3 years of applied experience
• Hands-on practical experience in system design, application development, testing, and operational stability
• Proficiency in coding in Java & Spark
• Knowledge of GKP & AWS Databricks.
• Experience in developing, debugging, and maintaining code in a corporate environment with modern programming languages
• Overall understanding of the Software Development Life Cycle
• Solid grasp of agile methodologies such as CI / CD, Application Resiliency, and Security.
• Demonstrated knowledge of software applications and technical processes within a technical discipline
• At least 3+ years of experience and strong knowledge in Scala programming language.
• Work independently on assigned tasks and take complete ownership from design to deployment.
• Collaborate with cross-functional teams for requirements gathering, design discussions, and delivery planning.
• Guide and mentor junior resources in coding best practices and problem-solving.
• Work with RDBMS and NoSQL databases to design and optimize storage solutions.
• Integrate applications with messaging services like Kafka and MQ for event-driven architectures.
• Ensure smooth deployments through CI / CD pipelines using Jenkins and Docker.
• Able to write clean, maintainable and efficient Scala code following best practices.
• Good knowledge on the fundamental Data Structures and their usage
• At least 2+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
• Having expertise in Spark Core, Spark SQL and Spark Streaming.
• Experience with Hadoop, HDFS, Hive and other BigData technologies.
• Familiarity with Data warehousing and ETL concepts and techniques
• Having expertise in Database concepts and SQL / NoSQL operations.
• UNIX shell scripting will be an added advantage in scheduling / running application jobs.
• At least 3 years of experience in Project development life cycle activities and maintenance / support projects.
• Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
• Understand project requirements and translate them into technical solutions which meets the project quality standards
• Ability to work in team in diverse / multiple stakeholder environment and collaborate with upstream / downstream functional teams to identify, troubleshoot and resolve data issues.
• Strong problem solving and Good Analytical skills.
• Excellent verbal and written communication skills.
• Experience and desire to work in a Global delivery environment.
• Stay up to date with new technologies and industry trends in Development.

(ref : hirist.tech)