YASH Technologies - Module Lead - Azure Data Factory

Key Responsibilities :

• Design, develop, and manage Azure Data Factory pipelines, datasets, dataflows, and integration runtimes.
• Implement data ingestion, transformation, and loading (ETL) processes using ADF, Azure Databricks, and Azure Synapse.
• Develop and optimize SQL scripts to perform complex queries and transformations.
• Build and monitor data migration pipelines from on-premise systems to Azure SQL or Synapse Analytics.
• Migrate databases from on-prem SQL Server to Azure using Azure Database Migration Service (DMS) and Data Migration Assistant.
• Create and maintain Synapse pipelines for migrating data from Data Lake Gen2 to Azure SQL.
• Work with Azure Data Catalog to manage and document data assets and lineage.
• Implement and optimize Big Data solutions for batch, interactive, and real-time data processing.
• Monitor and troubleshoot pipeline runs, ensuring data accuracy, reliability, and performance.
• Collaborate with cross-functional teams to understand business requirements and deliver scalable data solutions.

Required Skills & Qualifications :

Preferred Qualifications :

(ref : hirist.tech)