Azure Data Engineer

Job Description :

• Design develop and implement scalable data pipelines using Azure Data Factory to ingest data from various sources into Azure Data Lake Storage and other Azure data services.
• Develop and optimize data transformation processes using Azure Databricks with PySpark / Spark and Python ensuring data quality and efficiency.
• Design and implement data warehousing solutions using Azure Synapse Analytics or Azure SQL Database.
• Write complex SQL queries and stored procedures for data manipulation and analysis.
• Collaborate with data architects data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
• Implement data governance data quality and data security best practices within Azure data environments.
• Monitor troubleshoot and optimize data pipelines and data solutions for performance and reliability.
• Automate deployment and operational tasks using Azure DevOps or similar CI / CD tools.
• Stay updated with the latest Azure data technologies and recommend improvements to existing data infrastructure.

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full Time

Experience : years

Vacancy : 1