Role : Data Engineer (AWS)
Mandatory :
- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS.
- Experience in ingesting batch and streaming data from various data sources.
- Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)
- Experience in developing ETL, OLAP based and Analytical Applications.
- Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
- Comfortable working in Agile projects
Desirable :
Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)Knowledge of DevOps and CD / CD tools.Experience in handling unstructured dataKnowledge of Financial Markets domainKeywords : Data Engineer, Data Pipelines, Data Ingestion, AWS Lambda, AWS Athena
(ref : hirist.tech)