Azure Data Engineer

Detailed JD

• (Roles and Responsibilities)
• Experience in Databricks, PL / SQL, PySpark, Python, and Azure Data Factory (ADF).
• Experience in designing, developing, and maintaining data pipelines and data streams.
• Experience in moving / transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
• Experience in working with stakeholders to understand their data needs and provide solutions.
• Experience in collaborating with other teams to ensure data quality and consistency.
• Experience in developing and maintaining data models and data dictionaries.
• Optimize ETL processes for performance and scalability.
• Experience in developing and maintaining data integrity and accuracy
• Experience in developing and maintaining data governance policies and procedures.
• Experience in developing and maintaining data security policies and procedures.
• Good understanding of deployment processes
• Ability to manage customer handling

Flexible for support and maintenance type of project

Mandatory skills

Databricks, PySpark, Python, Azure Data Factory (ADF)

Skills Required

Azure Data Factory, Pyspark, Databricks, Python, Etl