Responsibilities :
- Azure Data Solutions Development : Design, develop, and maintain scalable and efficient data solutions primarily leveraging Azure Databricks and Azure SQL .
- Data Pipeline Construction : Build robust ETL / ELT data pipelines using Azure services, ensuring data quality, reliability, and efficient data flow.
- Python Development : Utilize Python for data manipulation, scripting, automation, and building data processing applications.
- Data Modeling & Warehousing : Work with data modeling concepts and contribute to the design and implementation of data warehouses and data lakes on Azure.
- Performance Optimization : Optimize data processes and queries for performance and cost efficiency within the Azure environment.
- Troubleshooting : Identify, troubleshoot, and resolve issues related to data pipelines, data quality, and Azure data services.
- Collaboration : Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver effective data solutions.
- Documentation : Create and maintain technical documentation for data pipelines, processes, and solutions.
Required Skills :
Proficiency in Azure Databricks .Proficiency in Azure SQL .Strong programming skills in Python .Strong understanding of data engineering principles and methodologies.Ability to design, develop, and troubleshoot complex data pipelines.Knowledge of data warehousing concepts.Skills Required
Azure Databricks, Azure Sql, Python, Data Modeling, Data Warehousing Concepts