Capco - Azure Databricks Platform Engineer - Insurance Data Infrastructure

Azure Databricks Platform Engineer - Insurance Data Infrastructure

Location : Pune / Bangalore / Mumbai / Chennai / Hyderabad / Gurugram

Band : M3 / M4 (7 to 14 years)

Key Responsibilities :

• Azure Databricks Platform Engineering - Design, deploy, and manage secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.
• Cloud Integration - Collaborate with architects, engineers, and security teams to establish infrastructure standards and ensure connectivity with legacy systems, cloud-native data sources, and third-party platforms.
• Infrastructure as Code (IaC) - Implement automated provisioning and configuration of Azure and Databricks resources using Terraform, supporting enterprise DevOps practices.
• Automation & CI / CD - Build and maintain GitHub Actions-based automation pipelines for environment deployment, monitoring, and incident response to ensure consistency, traceability, and efficiency.
• Performance & Scalability - Monitor platform health, optimize cluster utilization, and conduct tuning to ensure reliability, scalability, and cost efficiency for mission-critical workloads.
• Security & Compliance - Enforce enterprise and regulatory standards (RBAC, Key Vault, Managed Identities, Encryption, PDPO, GDPR, insurance compliance).
• Data Governance - Lead integration of Informatica tools for metadata management, cataloguing, lineage tracking, and compliance across the platform.
• Documentation & Governance - Prepare infrastructure architecture diagrams, network topology, security configurations, and runbooks for governance, audits, and operational readiness.
• Incident Management - Troubleshoot platform and infrastructure issues, perform RCA, and drive continuous improvements to enhance reliability.
• Innovation & Best Practices - Stay up to date with Azure, Databricks, and DevOps advancements, proactively recommending enhancements for platform efficiency and business value.

Requirements :

(ref : hirist.tech)