Experience : 12- 15 Years
Databricks Architect
Job Description :
- Design and implement scalable data architectures using Databricks and cloud-based platforms.
- Develop and maintain data models, databases, and ETL pipelines.
- Integrate legacy systems including MS Access into modern data platforms.
- Collaborate with software engineers to build data-driven applications using .NET technologies.
- Ensure data quality, governance, and security across all systems.
- Work closely with business stakeholders to understand data requirements and translate them into technical solutions.
- Optimize performance of data systems and troubleshoot issues as they arise.
- Document data architecture standards, processes, and best practices.
- Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integration frameworks using Databricks.
- Experience in Databricks cluster optimization and workflow management to ensure cost-effective and high performance processing.
- Sound knowledge of data modelling, data governance, data quality management, and data modernization processes.
- Develop architecture blueprints and technical design documentation for data solutions.
- Provide technical leadership and guidance on cloud architecture best practices, ensuring scalable and secure solutions.
Required Behavioral Competencies :
Accountability : Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team.Collaboration : Shares information within team, participates in team activities, asks questions to understand other points of view.Agility : Demonstrates readiness for change, asking questions and determining how changes could impact own work.Customer Focus : Identifies trends and patterns emerging from customer preferences and works towards customizing / refining existing services to exceed customer needs and expectations.Communication :Targets communications for the appropriate audience, clearly articulating and presenting his / her position or decision.Drives Results : Sets realistic stretch goals for self & others to achieve and exceed defined goals / targets.Resolves Conflict : Displays sensitivity in interactions and strives to understand others views and concerns.(ref : hirist.tech)