Data Engineer - Spark / Hadoop

About the Role :

We are looking for a highly skilled Data Engineer to join our clients Big Data team. The ideal candidate will have deep expertise in Hadoop, Spark, and modern data ecosystems, and will be responsible for designing, building, and optimizing data pipelines that power advanced analytics and large-scale processing.

You will collaborate closely with cross-functional teams, take ownership of key deliverables, and contribute to the evolution of data infrastructure and best practices within a fast-paced environment.

Key Responsibilities :

• Design, develop, and maintain robust big data pipelines and ETL workflows.
• Work extensively on Hadoop (Cloudera), Spark, Hive, Pig, and Impala to manage and analyze large-scale data sets.
• Optimize data processes for performance, scalability, and reliability.
• Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions.
• Troubleshoot and resolve complex data, networking, and software-related issues.
• Contribute to architecture design, data modeling, and integration strategies.
• Ensure best practices in data security, governance, and quality.
• Plan and organize work effectively, ensuring on-time delivery of assigned tasks.
• Mentor junior team members and support collective project goals.

Required Skills and Experience :

Preferred Qualifications :

Personal Attributes :

Additional Information :

(ref : hirist.tech)