Platform Data Engineer

Key Responsibilities

• Administer and optimize Azure Databricks, including clusters, jobs, and user access.
• Manage Snowflake environments (warehouses, roles / permissions, performance tuning, cost optimization).
• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.
• Enable data movement and replication across global environments.
• Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks.
• Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell.
• Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations.
• Ensure compliance with security, governance, and cost management best practices.
• Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery.
• Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation.
• Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency.

Required Skills and Experience

Soft Skills

Nice to Have