Sr. Engineer (MS Fabric Migration & Development)Innover Digital • Bengaluru, Karnataka, India
No longer accepting applications
Sr. Engineer (MS Fabric Migration & Development)
Innover Digital • Bengaluru, Karnataka, India
22 days ago
Job descriptionHands-on Migration and Development Pipeline Translation : Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala). Stored Procedure Conversion : Rewrite and optimize 30+ complex stored procedures into robust, scalable transformations using PySpark in Fabric Lakehouses or high-performance T-SQL in Fabric Data Warehouses. Data Modeling : Implement the designed data architecture (Medallion layers : Bronze, Silver, Gold) within OneLake , focusing on Delta Lake best practices and V-Order optimization for efficient querying. Large Data Handling : Execute the migration of 30+ TB of historical data efficiently and accurately, ensuring data integrity and reconciliation between the legacy and Fabric environments. Unit & Integration Testing : Develop and execute comprehensive unit and integration tests to validate the correctness and performance of migrated data pipelines and stored procedures. Performance Tuning : Work closely with the Technical Lead to identify and resolve data bottlenecks and optimize Spark code and Warehouse queries to meet latency requirements. Collaboration and DevOps Support CI / CD Adherence : Operate within the established DevOps pipeline, ensuring all code changes, notebooks, and object definitions are managed under Git version control and deployed via the automated CI / CD framework.
Required Qualifications
- Experience : 5+ years of dedicated experience in ETL / ELT development and data warehousing, with involvement in at least one major cloud data migration.
- Core Skills : Strong, demonstrable experience with the Azure Data Stack (ADF, Synapse) and hands-on development experience in Microsoft Fabric.
- Data Languages : Highly proficient in T-SQL for querying and procedural logic, and mandatory expertise in Python (PySpark) for data transformation.
- Data Modeling : Solid understanding of Kimball-style data warehousing, dimensional modeling, and modern Lakehouse concepts (Delta Lake, Parquet).
- Tools : Experience working with Git for source control and familiarity with the principles of CI / CD deployment.
Create a job alert for this search
Development Engineer • Bengaluru, Karnataka, India
Related jobs
![Sr Staff Engineer Agentic [T500-21075]](https://cdn-logos.talent.com/v1/logo/image?feedcode=whatjobs-in&company_name=Albertsons%20Companies%20India)
Sr Staff Engineer, Firmware Engineering
Confidential • Bengaluru / Bangalore, India
At Cepheid, we are passionate about improving health care through fast, accurate diagnostic testing.Our mission drives us, every moment of every day, as we develop scalable, groundbreaking solution...Show more
Last updated: 4 days ago • Promoted
Sr Advanced Hardware Engr
Confidential • Bengaluru / Bangalore, India
As a Sr Advanced Hardware Engr here at Honeywell, you will play a pivotal role in the design, development, and implementation of advanced hardware solutions.
Your expertise will be crucial in drivin...Show more
Last updated: 25 days ago • Promoted
Sr Staff Engineer, Firmware Engineering
Danaher • Bengaluru, Karnataka, India
This job is with Danaher, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.At Cepheid, we a...Show more
Last updated: 5 days ago • Promoted
Sr. Engineer (MS Fabric Migration & Development)
Innover Digital • Bengaluru, Karnataka, India
Hands-on Migration and Development.Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).Rew...Show more
Last updated: 22 days ago • Promoted
Lead Engineer (MS Fabric Migration & Development)
Innover Digital • Bangalore, Bangalore (district)
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show more
Last updated: 20 days ago • Promoted
Lead Engineer (Ms Fabric Migration & Development)
Innover Digital • Bengaluru, Republic Of India, IN
Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show more
Last updated: 22 days ago • Promoted
Sr Engineer, Development
Standard Chartered Bank • Bengaluru, Karnataka, India
This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly....Show more
Last updated: 30+ days ago • Promoted
Sr. Engineer, DVT (8082)
Confidential • Bengaluru / Bangalore
Client is a global client technology company and a leading provider of solar, battery, and electric vehicle charging products.
Founded in 2006, our innovative microinverter technology revolutionized...Show more
Last updated: 14 days ago • Promoted
Sr. Engineer Systems
Confidential • Bengaluru / Bangalore, India
Enphase Energy is a global energy technology company and a leading provider of solar, battery, and electric vehicle charging products.
Founded in 2006, our innovative microinverter technology revolu...Show more
Last updated: 20 days ago • Promoted
Sr Staff Engineer, Firmware Verification
Danaher • Bengaluru, Karnataka, India
This job is with Danaher, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.Are you ready to...Show more
Last updated: 5 days ago • Promoted
Sr Mechanical Engineer
Confidential • Bengaluru / Bangalore
This position is responsible for detailed mechanical design throughout the new product development lifecycle.This position may also be involved in the sustaining, VAVE, and quality improvement of I...Show more
Last updated: 30+ days ago • Promoted
SR MMIC Design Engineer
Confidential • Bengaluru / Bangalore, India
MMIC Design Engineer 5 to 10 years' experience.We are seeking a motivated, proactive, and intellectually curious MMIC Design Engineer who will work alongside world-class cross-disciplinary teams (s...Show more
Last updated: 13 days ago • Promoted
Sr Staff Engineer, Systems Integration
Danaher • Bengaluru, Karnataka, India
This job is with Danaher, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.At Cepheid, we a...Show more
Last updated: 5 days ago • Promoted
Sr. Platform Engineer
CME Group • Bengaluru, India
Join our Technology (DevOps) team as a Sr.In this critical role, you'll leverage your expertise in CI / CD, container orchestration (Kubernetes), and infrastructure-as-code to engineer the next gener...Show more
Last updated: 3 days ago • Promoted
Sr Engineer
Confidential • Bengaluru / Bangalore, India
Kenvue Is Currently Recruiting For a.At Kenvue, we realize the extraordinary power of everyday care.Built on over a century of heritage and rooted in science, we're the house of iconic brands - inc...Show more
Last updated: 25 days ago • Promoted
Sr. Engineer (Ms Fabric Migration & Development)
Innover Digital • Bengaluru, Republic Of India, IN
Hands-on Migration and Development.Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).Rew...Show more
Last updated: 22 days ago • Promoted
Synthesis Engineer
LeadSoc Technologies Pvt Ltd • Bengaluru, Karnataka, India
Job Description – Senior Synthesis Engineer (VLSI).We are seeking a highly motivated and experienced.The ideal candidate will have hands-on expertise in advanced technology nodes, physical synthesi...Show more
Last updated: 6 days ago • Promoted
Sr Staff Engineer Agentic [T500-21075]
Albertsons Companies India • Bengaluru, Karnataka, India
About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc.Our well-known banners across the United States, including Albertsons, Safeway, Vo...Show more
Last updated: 21 days ago • Promoted