Senior Data Engineer - PySpark / Scala

Description : Role Overview :

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data platforms within the Azure Databricks ecosystem. The ideal candidate will have strong expertise in PySpark / Scala, Delta Lake, and data pipeline architecture, along with experience leading complex data initiatives and mentoring team members.

Key Responsibilities :

• Lead and contribute to the development of a self-service data platform for reporting and analytics.
• Design and build data solutions using Databricks, SQL, Python, Spark, and Delta Lake within the Azure ecosystem (Blob Storage, Data Factory, Event Hubs).
• Implement best practices for ETL / ELT processes, focusing on data quality management, partitioning, maintainability, and reusability.
• Collaborate with engineers, product managers, and business leaders to ensure seamless integration of the data platform with systems such as Tableau, Power BI, APIs, and other applications.
• Establish CI / CD pipelines and use infrastructure-as-code tools for deployment and monitoring (Git, Terraform, Azure DevOps / GitHub Actions / Jenkins, Azure Monitor / Datadog).
• Ensure adherence to organizational compliance standards and Code of Conduct as defined in LogixGarden.

Required Skills & Experience :

Preferred Skills :

(ref : hirist.tech)