YASH Technologies - Technical Architect - Azure Databricks

Experience : 12- 15 Years

Databricks Architect

Job Description :

• Design and implement scalable data architectures using Databricks and cloud-based platforms.
• Develop and maintain data models, databases, and ETL pipelines.
• Integrate legacy systems including MS Access into modern data platforms.
• Collaborate with software engineers to build data-driven applications using .NET technologies.
• Ensure data quality, governance, and security across all systems.
• Work closely with business stakeholders to understand data requirements and translate them into technical solutions.
• Optimize performance of data systems and troubleshoot issues as they arise.
• Document data architecture standards, processes, and best practices.
• Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integration frameworks using Databricks.
• Experience in Databricks cluster optimization and workflow management to ensure cost-effective and high performance processing.
• Sound knowledge of data modelling, data governance, data quality management, and data modernization processes.
• Develop architecture blueprints and technical design documentation for data solutions.
• Provide technical leadership and guidance on cloud architecture best practices, ensuring scalable and secure solutions.

Required Behavioral Competencies :

(ref : hirist.tech)