Big Data Engineer - Scala / Spark / Python

Job Title : Big Data Engineer - Scala

Experience : 7 to 10Years (Minimum 3+ years in Scala)

Notice Period : Immediate to 30 Days

Role Overview :

We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities :

• Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
• Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
• Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
• Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
• Collaborate with cross-functional teams to design scalable cloud-based data architectures.
• Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
• Build monitoring and alerting systems leveraging Splunk or equivalent tools.
• Participate in CI / CD workflows using Git, Jenkins, and other DevOps tools.
• Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills :

Preferred Skills :

(ref : hirist.tech)