Senior Data Engineer - Java / Python / PySpark

Description :

We are looking for an experienced Data Engineer with a strong background in Java and hands-on expertise in Python / PySpark, Big Data technologies, and Google Cloud Platform (GCP). The ideal candidate should be capable of designing, developing, and maintaining large-scale data processing systems, ensuring data quality, scalability, and performance. Exposure to machine learning (ML) pipelines and data model optimization will be a strong advantage.

Key Responsibilities :

• Design, develop, and optimize data pipelines and ETL workflows using Java, Python, and PySpark.
• Work with Big Data frameworks (Hadoop, Spark, Hive, Kafka, etc.) for data ingestion and transformation.
• Implement and manage data solutions on GCP (BigQuery, Dataflow, Dataproc, Pub / Sub, Cloud Storage).
• Collaborate with data scientists and ML engineers to operationalize machine learning models.
• Optimize performance and scalability of distributed data processing systems.
• Ensure data quality, governance, and security throughout the data lifecycle.
• Work with cross-functional teams to translate business requirements into data solutions.

Required Skills :

Good to Have :

Education :

(ref : hirist.tech)