Principal Engineer - Scala / ETL

Description : Responsibilities :

• Lead technical initiatives and guide the team to develop innovative software solutions that address complex challenges.
• Build scalable, efficient, and high-performance pipelines and workflows for processing large volumes of batch and real-time data.
• Maintain and enhance existing software systems to ensure performance and reliability.
• Recommend and implement technology upgrades to drive continuous improvement.
• Support real-time streams, ETL pipelines, data warehouses, and reporting services.
• Design and develop data frameworks, applications, and microservices that seamlessly integrate with other services.
• Utilize Big Data tools such as Kafka, AWS S3 Data Lake, EMR, and Spark to ingest, store, transform, and query data.
• Adhere to coding best practices, including unit testing, design / code reviews, and comprehensive documentation.
• Conduct thorough code reviews to maintain quality, mentor junior team members, and promote continuous learning.
• Perform performance analyses and capacity planning for each release.
• Work effectively as part of an Agile team, contributing to process improvements and innovative solutions.
• Implement and promote security protocols and data governance standards across development projects.
• Proactively introduce new approaches to overcome software challenges throughout the product lifecycle.

Requirements :

Minimum qualifications :

(ref : hirist.tech)