Databricks Engineer - Python Frameworks

Job Description :

We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT experience, including at least 3 years of hands-on work in Databricks.

Key Responsibilities :

• Design, develop, and optimize ETL / ELT processes using Databricks.
• Develop and maintain data pipelines for large-scale data processing and analytics.
• Implement data transformations, cleansing, and validation within Databricks.
• Write efficient, reusable, and maintainable Python scripts to support data workflows.
• Integrate data from various sources, ensuring quality and consistency.
• Work with stakeholders to understand business requirements and translate them into technical solutions.
• Optimize Databricks clusters, notebooks, and workflows for performance and cost efficiency.
• Ensure adherence to data governance, security, and compliance standards.
• Troubleshoot and resolve issues in data pipelines and workflows.

Required Qualifications :

Preferred Skills :

(ref : hirist.tech)