Pipeline Translation : Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).
Stored Procedure Conversion : Rewrite and optimize 30+ complex stored procedures into robust, scalable transformations using PySpark in Fabric Lakehouses or high-performance T-SQL in Fabric Data Warehouses.
Data Modeling : Implement the designed data architecture (Medallion layers : Bronze, Silver, Gold) within OneLake, focusing on Delta Lake best practices and V-Order optimization for efficient querying.
Large Data Handling : Execute the migration of 30+ TB of historical data efficiently and accurately, ensuring data integrity and reconciliation between the legacy and Fabric environments.
Unit & Integration Testing : Develop and execute comprehensive unit and integration tests to validate the correctness and performance of migrated data pipelines and stored procedures.
Performance Tuning : Work closely with the Technical Lead to identify and resolve data bottlenecks and optimize Spark code and Warehouse queries to meet latency requirements.
Collaboration and DevOps Support
CI / CD Adherence : Operate within the established DevOps pipeline, ensuring all code changes, notebooks, and object definitions are managed under Git version control and deployed via the automated CI / CD framework.
Required Qualifications
Experience : 5+ years of dedicated experience in ETL / ELT development and data warehousing, with involvement in at least one major cloud data migration.
Core Skills : Strong, demonstrable experience with the Azure Data Stack (ADF, Synapse) and hands-on development experience in Microsoft Fabric.
Data Languages : Highly proficient in T-SQL for querying and procedural logic, and mandatory expertise in Python (PySpark) for data transformation.
Data Modeling : Solid understanding of Kimball-style data warehousing, dimensional modeling, and modern Lakehouse concepts (Delta Lake, Parquet).
Tools : Experience working with Git for source control and familiarity with the principles of CI / CD deployment.
Create a job alert for this search
Lead Developer • Bengaluru, Republic Of India, IN
Related jobs
Promoted
MS Azure Fabric Developer
ConfidentialBengaluru / Bangalore, India
A day in the life of an Infoscion.As part of the Infosys consulting team your primary role would be to lead the engagement effort of providing high quality and value adding consulting solutions to ...Show moreLast updated: 30+ days ago
Promoted
Oms Developer
Landmark GroupBengaluru, Republic Of India, IN
Landmark Web Team drives the digital transformation for the Landmark Group through Omni-Channel initiatives including E-commerce, loyalty and more.
Headquartered in Dubai, UAE, we currently build an...Show moreLast updated: 30+ days ago
Promoted
Lead Engineer (Ms Fabric Migration & Development)
Innover DigitalBengaluru, Republic Of India, IN
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 5 days ago
Promoted
Fabric OMS Consultant
ConfidentialBengaluru / Bangalore, India
A day in the life of an Infoscion.As part of the Infosys consulting team your primary role would be to get to the heart of customer issues diagnose problem areas design innovative solutions and fac...Show moreLast updated: 30+ days ago
Promoted
Lead Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 5 days ago
Promoted
Sr PTC FlexPLM Developer / Lead
KMM Technologies, Inc.hosur, tamil nadu, in
Position Name : Sr PTC FlexPLM Developer / Lead.Work Hours : M-F Working Hours : 9am EST to 2pm US EST.There is an urgent resource need with PTC FlexPLM software implementation experience.Senior Develop...Show moreLast updated: 30+ days ago
Promoted
Fabric Solutions Lead
Innover DigitalBengaluru, Republic Of India, IN
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 5 days ago
Promoted
Microsoft Fabric Architect
ConfidentialBengaluru / Bangalore
Design and implement scalable BI and data architecture using Microsoft Fabric and Lakehouse paradigms, including medallion architecture.
Architect and optimize ELT / ETL pipelines using SQL Server, Da...Show moreLast updated: 30+ days ago
Promoted
Microsoft Developer- Fabric
Sonata SoftwareBengaluru, Karnataka, India
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 5 days ago
Promoted
Microsoft Fabric Analytics Specialist
Sonata SoftwareBengaluru, Republic Of India, IN
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 5 days ago
Promoted
Microsoft Fabric Data Solutions Architect
Sonata SoftwareBengaluru, Republic Of India, IN
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 5 days ago
Promoted
New!
[15h Left] Lead Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India
Architectural Blueprint : Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.Pipeline & SP Conversio...Show moreLast updated: 1 hour ago
Promoted
Microsoft Developer- Fabric
ConfidentialBengaluru / Bangalore, India
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 3 days ago
Promoted
Microsoft Fabric Developer
Sonata SoftwareBengaluru, Karnataka, India
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 5 days ago
Promoted
Sr. Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India
Hands-on Migration and Development.Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).Rew...Show moreLast updated: 5 days ago
Promoted
Microsoft Fabric Developer
ConfidentialBengaluru / Bangalore, India
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 3 days ago
Promoted
Principal Fabric Migration Engineer
Innover DigitalBengaluru, Republic Of India, IN
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 5 days ago
Promoted
Microsoft Fabric Solutions Architect
Sonata SoftwareBengaluru, Republic Of India, IN
In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 5 days ago