We are seeking a highly skilled Senior Data Architect with extensive experience in data modeling, Azure Databricks, Azure OpenAI, and associated services. The ideal candidate will be responsible for designing and implementing a scalable, secure, and reliable global data store that supports both batch and near-real-time processing utilizing a medallion architecture. This role requires a deep understanding of data governance, particularly through Unity Catalog, DLT and proficiency in enabling data access via API and Power BI.
Key Responsibilities :
Design and implement a robust data architecture that supports scalable data storage and processing. - Develop and maintain data models that facilitate efficient data retrieval and analysis. - Utilize Azure Databricks and Azure OpenAI to enhance data processing capabilities and drive innovation. - Implement a medallion architecture to optimize data flow and ensure high-quality data is available for analytics. - Ensure data governance and compliance through the effective use of Unity Catalog. - Collaborate with cross-functional teams to define data access requirements and ensure seamless integration with APIs and Power BI. - Monitor and optimize data performance, ensuring reliability and security across the data ecosystem. - Stay current with industry trends and emerging technologies to continuously improve data architecture and practices.
Qualifications :
Bachelor’s degree in Computer Science, Information Technology, or a related field; - Proven experience as a Data Architect or similar role, with a strong portfolio of successful data architecture projects. - Expertise in data modeling techniques and best practices. - Proficient in Azure Databricks, Azure OpenAI, and associated Azure services. - Strong understanding of medallion architecture and its application in data processing. - Experience with data governance frameworks, particularly Unity Catalog. - Familiarity with API development and Power BI for data visualization. - Excellent problem-solving skills and the ability to work collaboratively in a team environment.