Data Engineer

Key Responsibilities

• Architect, develop, and operate enterprise-grade data pipelines using Microsoft Fabric, Azure Data Factory (ADF), PySpark, and Python, aligned to Medallion architecture.
• Rationalize and modernize the BI data landscape; deliver curated bronze, silver, and gold layers and performant semantic models.
• Implement data quality, governance, lineage, and observability across pipelines; ensure auditability and compliance.
• Migrate or retire legacy SSIS/SQL Server integrations to cloud-native, testable, cost-efficient solutions.
• Apply CI/CD best practices for data engineering using Azure DevOps/Git (branching, PRs, automated testing, environment promotion).
• Diagnose and resolve complex integration issues across cloud-native and legacy platforms; optimize performance and costs.
• Collaborate effectively with business analysts, transformation leads, and external partners; communicate progress and risks clearly.
• Contribute to Agile delivery cycles, demonstrating initiative, independence, and problem-solving skills.

Skills Required
Pyspark, Azure Data Factory, Python