Data Engineer

Data Engineer (Microsoft Fabric & Azure) - Relocation to KL

Position : Data Engineer

Department : Data & AI

Role Overview

The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures using Microsoft Fabric. This role focuses on enabling data ingestion, transformation, and governance across OneLake, Synapse, and Power BI, supporting downstream AI and analytics workloads.

Key Responsibilities

• Design and implement end-to-end data pipelines across Bronze, Silver, and Gold layers within Microsoft Fabric.
• Develop Dataflows Gen2, Spark notebooks, and Synapse pipelines to ingest data from databases, APIs, and files (Excel, CSV, etc.).
• Manage and optimize data storage within OneLake, including partitioning, schema evolution, and delta tables.
• Collaborate with AI Engineers to prepare and curate training datasets for ML / AI use cases.
• Integrate Fabric data outputs with Power BI semantic models and Copilot for Fabric.
• Implement data governance and lineage tracking through Microsoft Purview and Defender for Cloud.
• Monitor pipeline performance using Monitoring Hub, Azure Monitor, and Log Analytics Workspace.
• Automate deployments using CI / CD pipelines for Fabric and Azure Data Factory.
• Enforce data security policies, including role-level security (RLS) and data masking.

Qualifications

Preferred Skills

Location