Senior Data Engineer - W6862

What You'll Do

• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team
• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organisation.
• Lead and drive the team to deliver solutions on time and quality that committed.
• Write unit / integration tests, contributes to engineering wiki, and documents work.
• Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
• Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
• Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
• Design of data-oriented solutions (end to end) using design patterns and best market practices.
• Define and implement governance, access and security policies
• Ensure optimal use of resources both in cost and performance
• Ensure that non-functional requirements are taken care
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

What You Know

Education

Benefits