Data Engineer OpenData Commercial

We are seeking a skilled Data Engineer to design and build reusable and configurable data pipelines using a mix of standard cloud-based and proprietary data platforms. This role involves collaborating with data scientists to develop AI / ML proofs of concept into full implementations, creating documentation, and providing informal training to data analysts. You will also work closely with other engineering and product teams and provide guidance to more junior data engineers.

What You'll Do :

• Design and build reusable and configurable data pipelines using a mix of standard cloud-based and proprietary data platforms.
• Work with a data scientist to develop AI / ML proofs of concept into full implementations .
• Create documentation and provide informal training for data analysts on the configuration and use of tools and pipelines.
• Work with other engineering and product teams to understand proprietary platforms and provide input and feedback .
• Provide guidance to more junior data engineers on best practices.
• Work with security teams to ensure that all servers, platforms, and other resources meet security requirements .

Requirements :

Nice to Have :

Skills Required

data engineering , Data Modeling, Apache Spark, Aws