Talent.com
This job offer is not available in your country.
Data Engineering Lead

Data Engineering Lead

ConfidentialBengaluru / Bangalore, India
20 days ago
Job description

Job Description Summary

We are looking for a skilled and experienced Microsoft Fabric Data Engineer Lead with strong experience in designing, implementing, and managing data engineering solutions using Microsoft Fabric—a unified platform for data integration, analytics, and governance

Job Description

Site Overview

Established in 2000, the John F. Welch Technology Center (JFWTC) in Bengaluru is GE Aerospace's multidisciplinary research and engineering center. Pushing the boundaries of innovation every day, engineers and scientists at JFWTC have contributed to hundreds of aviation patents, pioneering breakthroughs in engine technologies, advanced materials, and additive manufacturing.

Role Overview

  • Architect scalable data solutions using Fabric components like Lake houses, Pipelines, and Dataflows
  • Lead data ingestion and transformation using tools such as Azure Data Factory, PySpark, SQL, and Kusto Query Language (KQL)
  • Ensure data quality and governance across Bronze (raw), Silver (cleansed), and Gold (curated) layers
  • Collaborate with cross-functional teams including analytics engineers, architects, and business stakeholders
  • Optimize performance and scalability of the data platform through monitoring and tuning
  • Mentor junior engineers and guide best practices in data engineering
  • Design and implement data models and schemas to support business requirements. Ensure data accuracy, consistency, and reliability. Optimize data structures for performance and scalability.
  • Good experience on Azure Purview integrating data pipelines with Purview for Data lineage, experience with Microsoft Fabric, migrating the application from Azure Data Factory and Azure Synapse to Microsoft Fabric
  • Implement robust data security measures, including encryption, access control, and data masking. Ensure compliance with data privacy regulations and company policies.
  • Monitor and optimize data pipelines and queries for performance and efficiency. Implement caching, partitioning, and indexing strategies. Troubleshoot and resolve performance issues.
  • Establish and enforce data quality standards. Implement data governance practices, metadata management, and data lineage tracking. Ensure data quality through validation and cleansing processes.
  • Collaborate with business stakeholders to understand data requirements and deliver.
  • Create and maintain comprehensive technical documentation, including system architecture, design documents, and deployment procedures. Ensure knowledge sharing within the team.
  • Implement Lean daily management and Lean continuous improvement concepts in Application development and operations.

Required Qualifications

  • Bachelor&aposs or master&aposs degree in computer science, Information Technology, or a related field.
  • Proven experience in Data integration and orchestration using Microsoft Fabric tools, Cloud platforms, especially Azure (Data Factory, Synapse, Power BI) and ETL / ELT pipelines, lakehouse architecture, and real-time analytics
  • Strong foundation in SQL, PySpark, and Kusto Query Language (KQL)
  • Excellent problem-solving skills and attention to detail,
  • Strong communication and leadership skills.
  • Relevant certifications (Microsoft Certified : Fabric Data Engineer Associate) are a plus.
  • Preferred Qualifications

  • Effective Communicator : Possess the ability to articulate complex technical concepts in a clear and concise manner, facilitating understanding across a wide range of audiences.
  • Solution-Oriented Mindset : Demonstrated ability to approach challenges with a solutions-first attitude, proactively identifying and addressing potential obstacles.
  • Change Advocate : Capable of spearheading and implementing change, showcasing a proactive approach to driving improvements and leading teams towards new initiatives.
  • Leadership Qualities : Show a strong capacity to lead, influence, and guide teams, fostering a collaborative and productive work environment.
  • Technical Translator : Excel at translating and breaking down intricate technical topics, ensuring that stakeholders at all levels have a clear understanding of the subject matter.
  • Analytical Thinker : Possess an analytical and detail-oriented mindset, critically evaluating information derived from multiple sources and drawing meaningful conclusions.
  • Team Player : Exhibit a strong willingness to collaborate and work cohesively with colleagues, understanding the importance of collective growth and knowledge sharing.
  • Adaptability : Demonstrate resilience and adaptability in an ever-changing environment, staying updated with the latest technological advancements and best practices in the field of database administration.
  • At GE Aerospace, we have a relentless dedication to the future of safe and more sustainable flight and believe in our talented people to make it happen. Here, you will have the opportunity to work on really cool things with really smart and collaborative people. Together, we will mobilize a new era of growth in aerospace and defense. Where others stop, we accelerate

    Additional Information

    Relocation Assistance Provided : No

  • This is a remote position
  • Show more

    Show less

    Skills Required

    Power Bi, Data Security, Pyspark, Data Quality, Data Governance, Sql, ELT, Azure Synapse, Azure Data Factory, Etl

    Create a job alert for this search

    Data Engineering Lead • Bengaluru / Bangalore, India

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inchosur, tamil nadu, in
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 5 days ago
    • Promoted
    Senior Full Stack SDE with Data Engineering for Analytics

    Senior Full Stack SDE with Data Engineering for Analytics

    Truckmentumhosur, tamil nadu, in
    Truckmentum is seeking a Senior Full Stack Software Development Engineer (SDE) with deep data engineering experience to help us build cutting-edge software and data infrastructure for our AI-driven...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Lead

    Technical Lead

    HCLTechhosur, tamil nadu, in
    NET MVC), Ensure all front-end and back-end components meet WCAG 2.RESTful APIs, version control (TFS), and CI / CD practices. Proven experience delivering WCAG 2.Proficiency in one or more MVC framew...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Xebiahosur, tamil nadu, in
    We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week). Data Engineering with 4+ years team leadership...Show moreLast updated: 30+ days ago
    • Promoted
    Project Manager – Data Engineering & Analytics

    Project Manager – Data Engineering & Analytics

    BrillioBengaluru, Karnataka, India
    We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show moreLast updated: 27 days ago
    • Promoted
    Engineering Manager - Bigdata

    Engineering Manager - Bigdata

    ScaleneWorks People Solutions LLPbangalore, karnataka, in
    We’re Hiring : Senior Engineering Manager – Big Data & Cloud.Big Data & Cloud Engineering team in.Lead and manage a high-performing team — setting objectives, conducting reviews, and driving results...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer & ML Analyst

    Lead Data Engineer & ML Analyst

    Eltropyhosur, tamil nadu, in
    We’re looking for someone with.Design and manage scalable ETL / ELT pipelines using AWS Glue, Redshift, S3, and Kafka / Kinesis. Architect and implement data lake and warehouse solutions following best ...Show moreLast updated: 10 days ago
    • Promoted
    Senior Engineering Manager-Big Data, Generative AI

    Senior Engineering Manager-Big Data, Generative AI

    Extreme NetworksBangalore, IN
    Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions.They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineering Manager

    Data Engineering Manager

    iMerit TechnologyBengaluru, Karnataka, India
    Merit is a leading AI data solutions company that transforms unstructured data into structured intelligence for advanced machine learning and analytics. Our customers span autonomous mobility, medic...Show moreLast updated: 11 days ago
    • Promoted
    Engineer II - Data Engineering [T500-20333]

    Engineer II - Data Engineering [T500-20333]

    lululemonBengaluru, Karnataka, India
    Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people in moving, growing, connecting, and being well.We owe our success...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyhosur, tamil nadu, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incBangalore, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineering Azure databricks

    Data Engineering Azure databricks

    EXLBengaluru, IN
    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 11 days ago
    • Promoted
    Lead Engineer

    Lead Engineer

    HCLTechhosur, tamil nadu, in
    Architect efficient and reusable front-end systems to support complex interactions within Meta HW infrastructure.Develop full-stack web applications for internal infrastructure tooling using techno...Show moreLast updated: 10 days ago
    • Promoted
    Lead Sustenance Engineer - Storage

    Lead Sustenance Engineer - Storage

    DDNhosur, tamil nadu, in
    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a globa...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDhosur, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIhosur, tamil nadu, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 16 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 18 days ago
    • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologieshosur, tamil nadu, in
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago