Big Data Engineer - Spark / Scala

Role & responsibilities :

• Evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders
• Design, develop, and maintain highly scalable data processing applications
• Write efficient, reusable and well documented code
• Deliver big data projects using Spark, Scala , Python, SQL
• Maintain and tune existing Spark applications to the fullest.
• Find opportunities for optimizing existing spark applications.
• Work closely with QA, Operations and various teams to deliver error free software on time
• Actively lead / participate daily agile / scrum meetings
• Take responsibility for Apache Spark development and implementation
• Translate complex technical and functional requirements into detailed designs
• Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions
• Serve as a mentor for junior staff members by conducting technical training sessions and reviewing project outputs

Qualifications :

(ref : hirist.tech)