Data Engineer - Python/SQL/ETL

Job Summary:

The Data Engineer is a core part of the Engineering team and is responsible for supporting the continued development and maintenance of our client's data models and pipelines.

This role is a key part of building a world-class data platform that provides access to clean and efficient data across all teams.

Key Responsibilities:

- Building data pipelines to move and transform data from various sources to storage systems as per ongoing business objectives and requirements.

- Developing and documenting solutions with clear, well-defined flowcharts, layouts, diagrams, and/or charts.

- Support and maintain any data platform failures or issues in the data systems by troubleshooting, proposing, and implementing solutions.

- Collaborate closely with other teams across the business, ensuring clear communication and understanding of business requirements.

- Continually staying up to date with the latest technologies and methodologies within data engineering to propose and implement innovative solutions.

- Identifying and implementing process improvements.

Senior Data Engineer Responsibilities:

- Supporting the Lead Data Engineer with coaching and mentoring junior team members.

- Collaborating with analysts and stakeholders to understand data requirements.

- Developing frameworks to support data systems and assist with extending functionality as our client continues to grow.

- Contributing to and supporting the strategic planning of data architecture as part of quarterly planning.

- Leading data projects end-to-end, ensuring ongoing collaboration with relevant stakeholders, and ensuring timelines are met.

- Promoting and presenting data engineering work both within the team and with external teams.

- Implementing Data Quality and Validation checks to improve the reliability of the data platform, ensuring optimal performance of data systems.

- Implementing and maintaining data security and compliance Knowledge and understanding of Data Warehousing concepts and methodologies.

- Working knowledge of Python and SQL.

- Experience and familiarity with data modelling techniques such as Star and Snowflake Schemas.

- Experience with platforms such as Snowflake, dbt, and Airflow.

- Familiarity with cloud platforms Azure, AWS, GCP.

- Experience with code version control tools like GitHub, GitLab.

- Strong verbal and written communication skills to work effectively within cross-functional teams.

- Ideally, experience working within the financial services domain or similar.

- Experience working in an agile environment.

(ref:hirist.tech)