Data Engineer - Python / ETL

The Data Engineer will be responsible for building and maintaining our data infrastructure to support reporting, analytics, and data science initiatives.

The ideal candidate will have strong skills in data architecture, ETL, SQL, and Python within a Git-managed environment, as well as a proven ability to collaborate with both business stakeholders and data team colleagues to deliver robust, scalable data frameworks.

This individual will possess strong operational skills to drive efficiency and speed, expertise in building repeatable data engineering processes, strong project management abilities, and a forward-looking vision for delivering impactful data :

• Create and orchestrate data pipelines within a state-of-the-art AWS environment (Redshift, EC2, EMR, S3, Lambda, Glue, etc.).
• Manage all aspects of the data and analytics ecosystem from ingestion to ETL to aggregate tablesto meet analytics and reporting needs.
• Design and implement internal data pipeline processes and improvements using modern techniques such as automation, optimization, and infrastructure redesign for scalability.
• Develop scripts for scheduling data ingestion and synchronization, and implement backend logic to create data marts based on business requirements for stakeholder self-service.
• Partner with data architects to build frameworks for defining metrics as code and optimizing data search and retrieval.
• Troubleshoot production data jobs and processes to resolve data quality issues and improve pipeline performance.
• Build and assemble large, complex data sets with multi-dimensional relationships to meet functional and non-functional business requirements.
• Develop integrations between systems to ensure seamless data flow.

Qualifications :

(ref : hirist.tech)