We are seeking a highly skilled Senior Azure Data Factory (ADF) Solution Architect to design, implement, and optimize data integration solutions using Azure Data Factory and related Azure services. This role requires expertise in architecting scalable, high-performance data pipelines while ensuring data security, governance, and compliance. The ideal candidate will work closely with stakeholders to define data strategies, design ETL / ELT processes, and support enterprise-wide data initiatives.
Key Responsibilities :
- Solution Architecture & Design : Design end-to-end data integration solutions using Azure Data Factory (ADF), Azure Synapse, Azure Data Lake, and other Azure services.
- Data Pipeline Development : Develop and optimize ETL / ELT pipelines to extract, transform, and load data from various sources into cloud data platforms.
- Data Strategy & Governance : Define best practices for data security, compliance, governance, and metadata management in Azure.
- Performance Optimization : Ensure high performance and scalability of data pipelines through effective partitioning, parallelism, and optimization techniques.
- Stakeholder Collaboration : Work closely with business teams, data engineers, and analysts to understand data requirements and translate them into scalable solutions.
- Automation & Monitoring : Implement CI / CD for data pipelines, automate deployment processes, and set up monitoring for performance and failure alerts.
- Documentation & Best Practices : Maintain architectural documentation, create guidelines for development teams, and ensure adherence to industry best practices.
Required Skills & Qualifications :
Experience : 8+ years in data engineering and architecture, with at least 4 years specializing in Azure Data Factory.Technical Expertise :Deep knowledge of Azure Data Factory (ADF), Azure Synapse, Azure Data Lake, and Azure Databricks .Strong experience with ETL / ELT development , data ingestion, and transformation processes.Proficiency in SQL, Python, or PowerShell for automation and data manipulation.Understanding of Azure security best practices , including role-based access control (RBAC), data encryption, and compliance.Hands-on experience with Azure DevOps, Git, CI / CD pipelines , and infrastructure as code (IaC) tools like Bicep or Terraform.Knowledge of data warehousing concepts, dimensional modeling, and data architecture patterns.Soft Skills : Strong problem-solving skills, excellent communication, and ability to work with cross-functional teams.Preferred Qualifications :
Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert ).Experience in real-time / batch data processing, streaming (Kafka, Event Hub), and AI / ML integration.Work Location :
While we are open to remote work, we strongly encourage local candidates based in the Gurgaon area to apply.
CONTACT KHURRAM AT EXT 109 OR khurram"at"khoj-inc"dot"com