Job Role: Azure Data Engineer
Job Location: Pune
Experience: 4+ Yrs
Skills: SQL + ETL + Azure + Python + Pyspark + Databricks
Job Description: As an Azure Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure on the Azure platform. You will collaborate with cross-functional teams to develop robust data pipelines, optimize data workflows, and ensure data integrity and reliability.
Responsibilities:
- Design, develop, and deploy data solutions on Azure, leveraging SQL Azure, Azure Data Factory, and Databricks.
- Build and maintain scalable data pipelines to ingest, transform, and load data from various sources into Azure data repositories.
- Implement data security and compliance measures to safeguard sensitive information.
- Collaborate with data scientists and analysts to support their data requirements and enable advanced analytics and machine learning initiatives.
- Optimize and tune data workflows for performance and efficiency.
- Troubleshoot data-related issues and provide timely resolution.
- Stay updated with the latest Azure data services and technologies and recommend best practices for data engineering.
Qualifications:
- Bachelors degree in computer science, Information Technology, or related field.
- Proven experience as a data engineer, preferably in a cloud environment.
- Strong proficiency in SQL Azure for database design, querying, and optimization.
- Hands-on experience with Azure Data Factory for ETL/ELT workflows.
- Familiarity with Azure Databricks for big data processing and analytics.
- Experience with other Azure data services such as Azure Synapse Analytics, Azure Cosmos DB, and Azure Data Lake Storage is a plus.
- Solid understanding of data warehousing concepts, data modeling, and dimensional modeling.
- Excellent problem-solving and communication skills.
Skills Required
Etl, Pyspark, Azure Data Factory, Sql, Azure, Databricks, Python