Sr. Engineer (Ms Fabric Migration & Development)
Innover DigitalBengaluru, Republic Of India, IN6 days ago
Job descriptionHands-on Migration and Development Pipeline Translation : Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala). Stored Procedure Conversion : Rewrite and optimize 30+ complex stored procedures into robust, scalable transformations using PySpark in Fabric Lakehouses or high-performance T-SQL in Fabric Data Warehouses. Data Modeling : Implement the designed data architecture (Medallion layers : Bronze, Silver, Gold) within OneLake, focusing on Delta Lake best practices and V-Order optimization for efficient querying. Large Data Handling : Execute the migration of 30+ TB of historical data efficiently and accurately, ensuring data integrity and reconciliation between the legacy and Fabric environments. Unit & Integration Testing : Develop and execute comprehensive unit and integration tests to validate the correctness and performance of migrated data pipelines and stored procedures. Performance Tuning : Work closely with the Technical Lead to identify and resolve data bottlenecks and optimize Spark code and Warehouse queries to meet latency requirements. Collaboration and DevOps Support CI / CD Adherence : Operate within the established DevOps pipeline, ensuring all code changes, notebooks, and object definitions are managed under Git version control and deployed via the automated CI / CD framework.
Required Qualifications
- Experience : 5+ years of dedicated experience in ETL / ELT development and data warehousing, with involvement in at least one major cloud data migration.
- Core Skills : Strong, demonstrable experience with the Azure Data Stack (ADF, Synapse) and hands-on development experience in Microsoft Fabric.
- Data Languages : Highly proficient in T-SQL for querying and procedural logic, and mandatory expertise in Python (PySpark) for data transformation.
- Data Modeling : Solid understanding of Kimball-style data warehousing, dimensional modeling, and modern Lakehouse concepts (Delta Lake, Parquet).
- Tools : Experience working with Git for source control and familiarity with the principles of CI / CD deployment.
Create a job alert for this search
Development Engineer • Bengaluru, Republic Of India, IN
Related jobs
The Contract Lifecycle Management (CLM) team is part of Payment Product Development (PPD) Technology team and is responsible for managing system requirements, design, development, integration, qual...Show moreLast updated: 30+ days ago
- Promoted
Sr Associate Engineer
ConfidentialBengaluru / Bangalore Responsible for system configuration and support activities on the following systems : workflow systems, specification management system, experiment management system, manufacturing execution system...Show moreLast updated: 30+ days ago
- Promoted
Sr. Engineer - Mechanical
ConfidentialBengaluru / Bangalore, India Creating Peace of Mind by Pioneering Safety and Security.At Allegion, we help keep the people you know and love safe and secure where they live, work and visit.
With more than 30 brands, 12,000+ emp...Show moreLast updated: 10 days ago
- Promoted
- New!
Manufacturing Engineer
GrinntechBengaluru, IN Manufacturing / Continuous Improvement Engineer.Grinntech is a dynamic and innovative full stack lithium battery tech startup committed to power up the electrification of Indian and Global mobility.A...Show moreLast updated: 2 hours ago
- Promoted
Lead Engineer (Ms Fabric Migration & Development)
Innover DigitalBengaluru, Republic Of India, IN Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 6 days ago
- Promoted
Sr. Engineer Systems
ConfidentialBengaluru / Bangalore, India Enphase Energy is a global energy technology company and a leading provider of solar, battery, and electric vehicle charging products.
Founded in 2006, our innovative microinverter technology revolu...Show moreLast updated: 4 days ago
- Promoted
Sr Engineer, Development
Standard Chartered BankBengaluru, Karnataka, India This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly....Show moreLast updated: 14 days ago
- Promoted
Lead Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.
Pipeline & SP Conversion Strategy : .Develop the m...Show moreLast updated: 6 days ago
- Promoted
Sr Associate Engineer Semiconductor Manufacturing
ConfidentialBengaluru / Bangalore Provide engineering support for semiconductor process operations Typically performs one or more of the following as directed and / or independently : .
Provides oversite and guidance of operational acti...Show moreLast updated: 30+ days ago
- Promoted
Sr Mechanical Engineer
ConfidentialBengaluru / Bangalore This position is responsible for detailed mechanical design throughout the new product development lifecycle.This position may also be involved in the sustaining, VAVE, and quality improvement of I...Show moreLast updated: 30+ days ago
- Promoted
Sr ML Engineer
ConfidentialBengaluru / Bangalore, India Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show moreLast updated: 10 days ago
- Promoted
Sr Engineer - Device Model Engineer
ConfidentialBengaluru / Bangalore Device model extraction for DC and RF frequencies (Diode, Varactor, Resistors etc.Definition of test structures and layout as and when necessary.
Knowledge of semiconductor physics and application i...Show moreLast updated: 30+ days ago
- Promoted
Lead Design Engineer (8-10 years)- Manufacturing and Process background, 5+ years’ experience in developing validation documentation
Marmon Technologies India Pvt LtdBengaluru, Karnataka, India Lead Mechanical Engineer will manage and complete task work for various engineering disciplines as well as manage and develop automated workflows utilizing Smartsheet.
As a Lead, you will be respons...Show moreLast updated: 19 days ago
- Promoted
- New!
Apply in 3 Minutes! Lead Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India Architectural Blueprint : Define the target state architecture within Microsoft Fabric, specifically optimizing for OneLake and theLakehouse paradigm to handle 30+ TB of data.Pipeline & SP Conversio...Show moreLast updated: 11 hours ago
Sr. SW Engineer (3 - 6 yrs of experience in Icertis, CLM, Development
MillimsBengaluru, Karnataka, IndiaQuick Apply
- Promoted
Sr. Engineer (MS Fabric Migration & Development)
Innover DigitalBengaluru, Karnataka, India Hands-on Migration and Development.Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark / Scala).Rew...Show moreLast updated: 6 days ago
- Promoted
Manufacturing Equipment Simulation Engineer
Tata ElectronicsBengaluru, Karnataka, India Tata Electronics Private Limited (TEPL) is a greenfield venture of the Tata Group with expertise in manufacturing precision components.
Tata Electronics (a wholly owned subsidiary of Tata Sons Pvt.I...Show moreLast updated: 30+ days ago
- Promoted
Sr. Technical Sales Engineer
ETA Technology Pvt. Ltd.Bengaluru, Karnataka, India ETA Technology is a leading Indian manufacturer of Special Purpose Machines (SPMs), proudly serving customers in 20+ countries.
We design and build cutting-edge.Special Purpose Machines (SPMs).Our i...Show moreLast updated: 6 days ago
- Promoted
Sr. Design Engineer
ConfidentialBengaluru / Bangalore, India Are you ready to accelerate your potential and make a real difference within life sciences, diagnostics and biotechnology.
At Cytiva, one of Danaher's 15+ operating companies, our work saves lives—a...Show moreLast updated: 30+ days ago