This job offer is not available in your country.

Cloudely - Databricks Consultant - Apache Spark

CLOUDELY INDIA PRIVATE LIMITEDIndia

30+ days ago

Job description

Databricks Consultant

Location : Remote

Experience : 5+ years

Job Overview :

We are looking for an experienced Databricks Consultant to design, develop, and optimize data solutions on the Databricks Lakehouse Platform.

The role involves building scalable data pipelines, implementing Delta Lake, and optimizing Spark jobs for performance.

Key Responsibilities :

Design and implement Databricks workflows, notebooks, and Delta Lake architectures.
Develop and optimize Apache Spark jobs for large-scale data processing.
Integrate Databricks with Azure services (ADLS, Synapse, ADF, etc.)
Implement data governance, security, and access control in Databricks.
Troubleshoot performance bottlenecks and optimize cluster configurations.
Collaborate with data engineers and analysts to ensure seamless data workflows.

Required Skills :

5- 7 years of hands-on experience with Databricks (PySpark, SQL, Delta Lake).

Strong expertise in Apache Spark optimization (partitioning, caching, tuning).

Experience with Azure cloud services (Storage, Synapse, Blob, etc.)

Knowledge of CI / CD pipelines for Databricks (Azure DevOps, GitHub Actions).

Familiarity with data modeling, ETL / ELT processes, and data warehousing.

(ref : hirist.tech)

Consultant • India