We are seeking an experienced Azure Data Platform Architect to join our team in Bangalore. This is a hybrid role, offering a blend of on-site collaboration and remote flexibility. The ideal candidate will be responsible for designing, building, and optimizing Azure-based data solutions, leveraging expertise across Azure Core Services, Modern Data Platform Architecture, and advanced Data Engineering technologies.
Key Responsibilities :
- Architect and implement Azure Modern Data Platform solutions.
- Design and optimize Apache Spark workloads using Azure Databricks, with proficiency in DataFrame / Dataset APIs, Structured and Streaming sources, Delta Lake, SparkSQL, and advanced Spark concepts (Lakehouse, Caching, Stream sources).
- Develop ETL pipelines and automate job scheduling using Azure Data Factory, including incremental loads from external sources (Oracle, SAP HANA, ERP), data flows, triggers, and resource optimization.
- Design, optimize, and secure Data Warehousing solutions (Azure SQL DB, Synapse Analytics, Data Lake, EDW, Snowflake alternatives), including SCDs, data modeling, migration, and data mesh architecture.
- Implement analytics solutions using SQL (Joins, Aggregates, Window Functions, Partitioning, Subqueries), T-SQL, and Microsoft BI stack (SSIS, SSAS, SSRS).
- Build and manage Azure Functions, Logic Apps, and App Services for integration and automation.
- Utilize additional Azure services (PowerShell, Stream Analytics, Event Hub, HDInsight, Service Bus) and manage authentication using Active Directory.
- Develop and maintain CI / CD pipelines via Azure DevOps, manage source code via Git / Bitbucket, and employ Azure Key Vault for secrets management.
Required Skills :
Deep hands-on experience with Azure Data Bricks, Apache Spark (PySpark / Scala), and Spark performance tuning.Strong background in Azure Data Factory ETL development and external data integration.Expertise in Data Warehousing, Data Modeling, and Azure SQL services.Strong SQL and data analytics skills.Knowledge of Azure Functions, Logic Apps, and related serverless components.Familiarity with Azure Stream Analytics, Event Hub, HDInsight, Service Bus.Cloud DevOps : Hands-on with Azure DevOps (CI / CD), GIT / Bitbucket, secrets management (Key Vault).Understanding of data security, migration, and modern data architectures.Excellent communication and documentation skills.Good to Have :
Previous experience with Data Mesh and large-scale data migrations.Knowledge of other cloud platforms and hybrid cloud integrations.(ref : hirist.tech)