Senior Data Engineer - ETL

Key Responsibilities :

• Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
• Build scalable and automated MLOps pipelines for model training, validation, and deployment using AWS SageMaker and related services.
• Implement and manage Infrastructure as Code (IaC) using Terraform for AWS provisioning and maintenance.
• Collaborate with ML, Data Science, and DevOps teams to ensure reliable and efficient model deployment workflows.
• Optimize data storage and retrieval strategies for both structured and unstructured large-scale datasets.
• Integrate and transform data from multiple sources into data lakes and data warehouses.
• Monitor, troubleshoot, and improve performance of cloud-native data systems in a fast-paced production setup.
• Ensure compliance with data governance, privacy, and security standards across all data operations.
• Document data engineering workflows and architectural decisions for transparency and maintainability.

Requirements :

(ref : hirist.tech)