Job Title : Data Engineer
Experience : 2-3 Years
Qualification : Bachelor's degree or equivalent experience in Computer Science
Responsibilities :
- Manage and optimize data processes, working with large and multi-dimensional datasets.
- Develop, implement, and optimize complex data transformation ETLs.
- Design and develop data architectures using Python, PySpark, and Apache Spark.
- Utilize AWS cloud services in the data domain and / or other technologies such as Snowflake, Dataiku, and Alteryx.
- Handle On-Prem / Cloud Data warehouse databases.
- Keep updated with emerging trends in data tools, analysis techniques, and data usage.
Requirements :
Minimum 2-3 years of data engineering experience.Proven experience working with Python, PySpark, Apache Spark, and data services on the cloud.Strong understanding of data modelling principles; ability to produce, maintain, and update data models as per specific business needs.Experience working with various data platforms including Knowledge of On-Prem / Cloud Data warehouse databases.Technical leadership skills, with a demonstrated ability to lead and deliver projects independently.Ideal Candidate :
Experience with cloud data engineering tools / components / technologies such as AWS Glue, EMR, Azure Data Factory.Continual learning mindset to understand emerging trends in the data science field(ref : hirist.tech)