Data Architect

Job Title : Data Architect

Exp Range : 12 - 18

Job Location : Kolkata Only

Job Description :

Required skill : Databricks, AWS ,RedshiftEDW DB to Databricks Lakehouse Platform on AWS

12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS

1. 12+ years with 4-5+ years in Cloud Data Architecture, Databricks and AWS

2. Should have experience of migration of an enterprise data warehouse from AWS Redshift / RDS or any other EDW DB to Databricks Lakehouse Platform on AWS. Conversant with cloud-native architectures, Databricks platform capabilities and modern data Lakehouse design patters. Can able to own end-to-end architecture, including migration strategy, data modeling, governance and performance optimization.

3. Key Responsibilities :

a) Architecture & Strategy : Define target architecture, conduct gap analysis, design data Ingestion, storage, transformation and consumption layer using delta lake along with Databricks best practices

b) Data Modeling & Design : Translate existing DWH / DB star / srowflake schemas into Databricks-optimized Delta Lake models, implement SCD, fact / dimension modeling, ACID compliance, partitioning etc.

c) Governance, Security & Compliance : Implement data governance, cataloging, lineage using Unity Catalog and AWS Glue; define RBAC, data masking, encryption, etc.

d) Migration Execution Oversight : Work with DEV team for SQL-to-Spark migration; oversee data validation & reconciliation; work with DevOps team to design CI / CD pipelines for Databricks jobs, etc