Big Data Developer - Scala / Spark

Company : : Visit Type : Consulting Firm

Company Type : Model : Stage : : IT Description :

We are looking for an experienced Senior Big Data Engineer (Scala / Spark) with 8+ years of expertise in designing and developing large-scale, distributed data processing pipelines. The role requires strong knowledge of Scala, Apache Spark (Core, SQL, Streaming), and related Big Data Responsibilities :

• Write clean, maintainable, and efficient Scala code following best practices.
• Design and develop large-scale, distributed data processing pipelines.
• Work with Hadoop ecosystem tools (HDFS, Hive, etc.).
• Apply knowledge of data structures, databases (SQL & NoSQL), and ETL techniques.
• Optimize data pipelines for performance and scalability.
• Use Agile practices, including daily standups, sprint planning, and retrospectives.
• Collaborate with cross-functional teams to troubleshoot and resolve data issues.
• Support project life cycle activities including development, maintenance, and production support.
• Stay updated with new technologies and industry :
• 8+ years of experience in Scala programming and Big Data development.
• Strong expertise in Spark Core, Spark SQL, Spark Streaming.
• Hands-on with Hadoop, Hive, HDFS.
• Familiarity with UNIX shell scripting for scheduling / running jobs.
• Strong problem-solving and analytical skills.
• Excellent verbal and written communication.
• Experience working in global delivery environments.

(ref : hirist.tech)