Adastra - Databricks Data Engineer - Python / ETL / SQL

As a Databricks Data Engineer, you will be responsible for :

• Technical Requirements Gathering and Development of Functional Specifications.
• Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services.
• Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks.
• Develop and integrate custom machine learning models using Azure Machine Learning, MLflow, and other relevant libraries.
• Leverage Azure DevOps and CI / CD best practices to automate the deployment and management of data pipelines and infrastructure.
• Conducting troubleshooting on data models.
• Work with the Agile multicultural teams in Asia, the EU, Canada, and the Requirements :

For this position as Databricks Data Engineer, we are looking for someone with :

(ref : hirist.tech)