Description :
Key Responsibilities :
- Design and build secure, scalable, and reliable data pipelines using Azure Data Factory, Synapse Analytics, and other Azure services.
- Develop ETL / ELT processes to ingest data from multiple sources including APIs, databases, and flat files.
- Work with structured and unstructured data to support analytics, data science, and business intelligence needs.
- Optimize data storage and performance using Azure Data Lake Storage, SQL Database, and Synapse.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
- Implement and maintain CI / CD pipelines for data workflows using Azure DevOps or similar tools.
- Ensure data governance, quality, and security standards are met across all data solutions.
- Monitor and troubleshoot data pipelines, ensuring minimal downtime and high reliability.
Required Skills & Qualifications :
Bachelor's degree in Computer Science, Engineering, or a related field.3+ years of experience as a Data Engineer, with at least 2+ years on Azure.Strong knowledge of Azure Data Factory, Azure Synapse Analytics, MySQL, PySpark and DataBricks.Proficiency in SQL, Python for data transformation and scripting(ref : hirist.tech)