Job Summary :
We are looking for a highly skilled Azure Data Engineer with strong expertise in Azure Synapse Analytics, SQL Server, and Azure Data Factory (ADF) . The ideal candidate should have hands-on experience in building and maintaining scalable data pipelines, implementing CI / CD processes, and working in a cloud-based data ecosystem. Experience with PySpark and DevOps practices will be an added advantage.
Key Responsibilities :
- Design, develop, and maintain data integration and transformation pipelines using Azure Synapse and Azure Data Factory (ADF) .
- Work extensively with SQL Server / T-SQL for data modeling, optimization, and performance tuning.
- Implement and manage CI / CD pipelines for data solutions using Azure DevOps or equivalent tools.
- Develop PySpark-based ETL processes for large-scale data transformation and ingestion.
- Collaborate with data architects, analysts, and business stakeholders to define data requirements and deliver optimized solutions.
- Ensure data quality, consistency, and security across various data sources and environments.
- Troubleshoot and resolve data integration and performance issues in a timely manner.
Technical Skills Required :
Primary Skills :
Azure Synapse AnalyticsSQL Server / T-SQLAzure Data Factory (ADF)PySparkSecondary Skills :
CI / CD (Azure DevOps preferred)General DevOps practices and pipeline automationGood to Have :
Exposure to data lake architecture and performance tuning in AzureExperience with Power BI or other data visualization toolsKnowledge of Agile / Scrum methodologies