Understand the data requirements, source data land scape of the project and architect the solution. Ability to understand the data requirements and come up with the proposed solution components.
Hands on experience in designing cost-efficient, fault tolerant and scalable distributed systems on Azure. Understand the data processing requirements like batch computing, stream computing needs and design the solution on Azure technical stack.
Design Data Lake, Data Warehouse, experience with Data Modelling
Estimate the sizing of the data solution components based on key volumetric statistics. Develop architecture blueprints and detailed documentation. Create bill of materials, including required Cloud Services and tools;
In depth knowledge of Azure components like Azure VMs, Azure data lake, Azure blob storage, Azure SQL database, Azure Synapse (Azure SQL data warehouse )
Experience with Azure data factory , Azure Databricks, , Unity catalog , data flow and ETL tools.
Experience with Microsoft Fabric , Lakehouse architecture and Delta lake
Exposure to NoSQL databases, distributed computing using Azure Data Bricks
Finalizing and preparing the templates of design documents, data flows, mapping documents, implementation and maintenance plans. Set up process, services and tools around cloud
Design the overall Virtual Private Cloud VPC environment including server instance, storage instances, subnets, availability zones, etc
Deep understanding of Spark, Python, Kafka, Azure Event Hubs. Designing applications with distributed computing technologies.
Exposure to data catalogue tools like Azure data catalogue
Experience with CI tools like Azure DevOps, Jenkins (or any other tools) for smoother roll out of the production applications
Knowledge of best practices and market trends pertaining to Cloud and overall industry to provide thought leadership and mentor team to build necessary competency
Excellent verbal, written and presentation skills. Ability to quickly connect with key stakeholders in the organization, client and the teams.
Ability to drive the teams from architecture stand point of view.