Job Title : Data Engineering Azure Databricks
Our team is looking for a skilled Data Engineer to design, develop, and maintain data assets and related products. This role requires strong knowledge of data engineering principles, including ETL processes, data integration, and diagram documentation.
- Collaborate with stakeholders to understand data requirements and design complex data pipelines.
- Develop and maintain data models, including schema design and optimization.
- Lead data validation, UAT, and regression testing for new data asset creation.
Required Skills and Qualifications :
Strong knowledge of Python, Pyspark, SQL, Hadoop, Hive, Azure Databricks, Greenplum, and big data technologies.Experience in developing ETL processes using Azure Data Factory and big data processing analytics with Azure Databricks.Good communication, problem-solving, analytical, time management, multi-tasking, attention to detail, and accuracy skills.Degree in Data Science, Statistics, Computer Science, or other related fields, or equivalent combination of education and experience.Preferred Qualifications :
4-7 years of experience in Data Engineering.Proficiency in programming languages commonly used in data engineering.Experience in Azure cloud computing platform.