Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

WissenBengaluru, Karnataka, India
7 hours ago
Job description

Wissen Technology isHiring forLead Data Engineer

About Wissen Technology :

Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges

Role Overview : We are seeking a Lead Data Engineer to design and build a modern, cloud-native hybrid transactional and analytical processing (HTAP) data platform using the Microsoft Azure ecosystem, including Microsoft Fabric. The platform will process large volumes of structured and semi-structured data from external entities, apply complex validation logic, and serve both transactional and analytical needs across business functions. This is a high-impact, hands-on leadership role requiring architectural vision, hands-on implementation, and the ability to drive platform standardization at scale

Experience : 8-12Years

Location : Bangalore

Key Responsibilities

  • Lead the architecture and implementation of an enterprise-grade data platform using Microsoft Fabric and related Azure services
  • Design and implement a Medallion architecture (Bronze / Silver / Gold layers) to manage raw, validated, and curated data
  • Develop real-time data ingestion, validation, and transformation pipelines supporting heterogeneous file formats
  • Build and orchestrate event-driven workflows using serverless Azure Functions, Event Hub, and Durable Functions
  • Integrate Fabric Lakehouses and Synapse Data Warehousing with transactional systems and UI components
  • Implement schema evolution, metadata management, and lineage tracking across the platform
  • Enable business self-service through configurable rules engines and validation UIs
  • Ensure role-based access control (RBAC), end-to-end encryption, and audit trails are enforced across all layers
  • Build CI / CD pipelines and monitoring for automated deployments and observability
  • Collaborate with UI engineers, solution architects, product owners, and compliance stakeholders
  • Lead and mentor a team of data engineers; establish coding and documentation standards

Required Skills and Qualification

  • 8-12 years of hands-on experience in data engineering, including 3+ years in a leadership or architecture role
  • Strong expertise in Microsoft Azure, especially :
  • Microsoft Fabric (Data Lakehouses, Pipelines, Real-Time Analytics, Synapse)
  • Azure Data Factory, Azure Functions, Event Hub / Service Bus
  • Delta Lake on ADLS Gen2
  • Azure API Management and App Services
  • Advanced knowledge of Python, PySpark, SQL, and workflow orchestration
  • Experience building event-driven, serverless architectures in a production environment
  • Deep understanding of schema-agnostic ingestion, validation logic, and dynamic rule engines
  • Knowledge of data privacy, regulatory compliance, lineage, and auditability
  • Experience integrating with transactional UIs and REST APIs for CRUD operations
  • Proven track record delivering large-scale, cloud-native data platforms

    • Good To Have :

  • Domain knowledge in insurance, financial services, or regulatory systems
  • Familiarity with RE7 / FSRI, master data integration, or third-party systems
  • Experience with retention, premium, or commission calculations
  • Prior exposure to Microsoft Purview, Azure Monitor, and Azure Key Vault
  • Understanding of multilingual support, global data residency compliance, and deployment automation

    • The Wissen Group was founded in 2000. Wissen Technology, a part of the Wissen Group, was establishedin 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world-class products. We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation.

    Over the years, Wissen Group has successfully delivered $1 billion worth of projects for

    Create a job alert for this search

    Lead Data Engineer • Bengaluru, Karnataka, India