For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates
using the following resources : Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.
Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.
Tasks and Responsibilities :
Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,
Use data pipeline jobs to curate extracted raw data
Use data pipeline jobs to apply transformation based on reporting needs
Data source connectors to ingest the data from various data sources
Write the spark SQLs to produce the datasets
Monitor, troubleshoot and remediate the above jobs
Maintenance of the existing data models in the data lake and data warehouse
Design & Implement data models for new data sources as required
Profile :
Senior Data Engineer • tumakuru, karnataka, in