About the Role :
We are looking for a highly experienced GenAI + Databricks Architect with strong expertise in advanced analytics, Artificial Intelligence (AI), Machine Learning (ML), and Data Engineering to lead the design and implementation of scalable data solutions.
The role demands deep technical knowledge combined with strong architectural skills to drive innovation and operational excellence within large-scale data environments, leveraging Databricks, Azure Data Factory, and GenAI Responsibilities :
- Lead the end-to-end design, development, and deployment of advanced analytics and AI / ML solutions on Databricks and Azure cloud platforms.
- Architect scalable and robust data pipelines, ensuring efficient data ingestion, transformation, and storage within the Databricks ecosystem.
- Drive GenAI initiatives by designing and implementing AI models, leveraging cutting-edge generative AI frameworks and Python programming.
- Collaborate with business stakeholders to gather and analyze complex requirements and translate them into technical solutions with measurable business impact.
- Oversee governance, data quality, security, and compliance processes to ensure data integrity and regulatory adherence.
- Mentor and guide development teams on best practices, code standards, and architectural patterns related to AI, ML, and data engineering.
- Implement and optimize data workflows using Azure Data Factory, integrating various data sources and destinations efficiently.
- Develop and maintain dashboards and visualizations using Power BI to enable data-driven decision-making.
- Drive continuous improvement by evaluating new technologies and tools within the GenAI and cloud data engineering ecosystem.
- Manage remote and distributed teams effectively, ensuring collaboration and timely delivery across nearshore or offshore models.
- Engage with cross-functional teams, including data scientists, engineers, and business analysts, to align technical solutions with strategic Qualifications :
- 12 to 15+ years of experience in Business Intelligence (BI), Data Engineering, and Advanced Analytics.
- At least 5 years of hands-on experience in AI / ML, Generative AI, and Python development at an architect or senior technical level.
- Extensive expertise in Databricks, including architecture design, cluster management, and Spark programming.
- Strong experience in Azure Data Factory for orchestrating and automating data workflows.
- Proficiency with data visualization tools, preferably Power BI, for building enterprise-grade dashboards.
- Solid understanding of cloud architecture principles, data governance, and security best practices.
- Proven ability to manage complex projects end-to-end, from requirement gathering through design, build, deployment, and operational governance.
- Strong leadership and mentoring skills with experience managing remote or distributed teams.
- Excellent communication and stakeholder management skills to work effectively in diverse and collaborative environments.
(ref : hirist.tech)