ML OPs

ROLE PURPOSE

The ML Platform Specialist will be responsible for designing, implementing, and maintaining robust machine learning infrastructure and workflows using Databricks Lakehouse Platform. This role is critical in ensuring the smooth deployment, monitoring, and scaling of machine learning models across our organization.

Must Have-

Their experience with Databricks and its MLOps services

Their DevOps expertise and background

KEY ACCOUNTABILITIES

• Design and implement scalable ML infrastructure on Databricks Lakehouse Platform
• Develop and maintain continuous integration and continuous deployment (CI / CD) pipelines for machine learning models using Databricks workflows.
• Create automated testing and validation processes for machine learning models with Databricks MLflow
• Implement and manage model monitoring systems using Databricks Model Registry and monitoring tools
• Collaborate with data scientists, software engineers, and product teams to optimize machine learning workflows on Databricks.
• Develop and maintain reproducible machine learning environments using Databricks Notebooks and clusters.
• Implement advanced feature engineering and management using Databricks Feature Store
• Optimize machine learning model performance using Databricks runtime and optimization techniques.
• Ensure data governance, security, and compliance within the Databricks environment.
• Create and maintain comprehensive documentation for ML infrastructure and processes.
• Working across teams from several suppliers (including IT Provision, system development, business units and Programme management).
• Continuous improvement and transformation initiatives for MLOps / DataOps in RSA

FUNCTIONAL / TECHNICAL SKILLS