Lead Data Engineer (Databricks)

About the Role

We are looking for a highly skilled Data Engineer with strong hands-on experience in Databricks, PySpark, GCP , and cloud data infrastructure . The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data-driven decision-making.

Key Responsibilities

• Design, build, and optimize scalable data pipelines and ETL processes using Databricks and PySpark .
• Implement and manage Unity Catalog for data governance, lineage, and access control.
• Develop and maintain infrastructure as code using Terraform for GCP services.
• Create and manage CI / CD pipelines for data engineering workflows.
• Work with GCP Services such as Cloud Build, BigQuery, Firestore , and other related tools.
• Ensure high data quality, security, and availability across all data platforms.
• Collaborate with cross-functional teams including data scientists, analysts, and DevOps engineers.
• Troubleshoot data-related issues and optimize performance.

Required Skills

Good to Have