Senior Big Data Engineer - Hadoop / Spark

About the Role :

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :

• Design, develop, and maintain scalable and high-performance data processing systems.
• Build robust ETL / ELT workflows for structured and unstructured data.
• Implement real-time and batch data processing solutions.
• Optimize and tune big data systems for maximum efficiency and reliability.
• Collaborate with data scientists, analysts, and business teams to deliver high-quality data solutions.
• Ensure data governance, security, and compliance standards are Skills & Experience :
• 6+ years of experience as a Big Data Engineer or in a similar role.
• Strong expertise in big data technologies such as Hadoop, Spark, Hive, HBase, Kafka, Flume.
• Proficiency in SQL and at least one programming language (Java, Scala, or Python).
• Experience with cloud platforms like AWS, Azure, or GCP and their big data services.
• Hands-on experience in building and managing data pipelines using tools like Airflow, NiFi, or similar.
• Strong problem-solving skills and ability to work with large-scale to Have :
• Experience with containerization and orchestration (Docker, Kubernetes).
• Exposure to NoSQL databases (Cassandra, MongoDB).
• Knowledge of machine learning : Bachelors / Masters degree in Computer Science, Information Technology, or related field.

(ref : hirist.tech)