Senior Big Data Engineer - Hadoop / Kafka / Spark

Position : Big Data Engineer

Experience : 59 Years

Job Type : Full-time

Job Summary :

We are seeking a highly skilled Big Data Engineer with 59 years of experience to develop, maintain, and optimize robust, scalable big data solutions. This role requires expertise in designing and implementing solutions using Hadoop-based technologies and AWS. The engineer will be crucial in building various complex Big Data platform components, focusing on optimizing data access, handling high data volumes, and ensuring real-time performance using frameworks like Spark, Kafka, and other cloud technologies.

Key Responsibilities :

Big Data Platform Architecture and Design :

• Lead the design of comprehensive data solutions leveraging Hadoop-based technologies in conjunction with AWS cloud infrastructure.
• Implement and design various critical Big Data platform components, including Batch Processing, Live Stream Processing, In-Memory Cache, Query Layer (SQL), Rule Engine, and Action Framework.
• Design and implement a robust Data Access Layer capable of connecting to diverse data sources.

Performance and Scalability :

Data Pipeline and Infrastructure :

Preferred Skills :

(ref : hirist.tech)