Data Engineer - Spark / Hadoop

Key Responsibilities :

• Build and optimise data ingestion, transformation, and integration pipelines across multiple sources - clinical trials, EHR / EMR, laboratory systems, and commercial platforms.
• Implement data lakes and data warehouses using modern cloud technologies (Azure, AWS, or GCP).
• Develop and manage ETL / ELT workflows using tools such as Databricks, Azure Data Factory, or AWS Glue.
• Ensure data quality, lineage, and governance aligned with compliance frameworks (HIPAA, GxP, GDPR).
• Collaborate with data scientists and analytics teams to create reusable data models and feature stores.
• Optimise data access and performance for analytical workloads and visualisation tools.
• Automate deployments and monitoring using DevOps pipelines (Git, Jenkins, Azure DevOps).

Required Skills & Experience :

Good to Have :

(ref : hirist.tech)