Responsibilities
- Assist in implementing and optimizing enterprise-scale data pipelines using Azure ADF, Synapse, Databricks, and Stream Analytics.
- Support data ingestion, transformation, orchestration, and storage workflows ensuring data reliability and availability.
- Ensure seamless batch and real-time data processing with high availability and fault tolerance.
- Contribute to automation efforts : CI / CD pipelines, automated testing, and version control using Azure DevOps and Terraform.
- Collaborate with data engineering, AI / ML, CloudOps, and BI teams to support data-driven initiatives.
- Ensure DataOps practices meet compliance, regulatory, and security requirements.
- Participate in sustainment, testing, and monitoring of global data products.
- Support agile intake and execution processes for improved delivery efficiency.
- Troubleshoot issues related to cloud infrastructure and data services in partnership with technical teams.
Skills Required
Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Microsoft Azure