Description : Job Description :
We are looking for an experienced Senior Spark Developer with a strong background in Scala, Java, and Big Data technologies.
The ideal candidate will have 5+ years of development experience, including expertise in Spark-based data processing, Java server-side development, and working in fast-paced, low-latency environments. A financial services background is highly desirable.
Key Responsibilities :
- Design, develop, and optimize large-scale data processing applications using Apache Spark with Scala and Java
- Develop and maintain low-latency server-side Java applications
- Work with SQL, UNIX / Linux, and the broader Hadoop ecosystem (HDFS, Hive, HBase, Impala)
- Implement real-time and end-of-day (EOD) data processing using Spark (micro-batching and streaming)
- Collaborate with cross-functional teams to meet delivery goals and timelines
- Contribute to solution design and system architecture discussions
- Write clean, efficient, and testable code following best practices
- Troubleshoot production issues and ensure high availability of applications
Required Skills :
5+ years of hands-on development experienceExpertise in Spark with Scala and JavaProficient in SQL and Unix / Linux scriptingStrong knowledge of Hadoop ecosystem tools (HDFS, Hive, Impala, HBase)Experience with Java server-side development in low-latency environmentsProven problem-solving and analytical skillsAbility to work under pressure and manage multiple tasks simultaneouslyStrong communication and collaboration skillsPreferred Qualifications :
Financial services industry experienceUnderstanding of real-time data processing concepts and architectureFamiliarity with Agile methodologies and SDLC best practicesEnthusiastic, self-motivated, and eager to learn new technologies(ref : hirist.tech)