Senior Data Engineer - Python

Responsibilities :

• Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools.
• Understanding of banking data models, financial reporting, and regulatory compliance.
• Integrate data from legacy banking platforms into modern data lakes and warehouses.
• Collaborate with business analysts, architects, and operations teams to understand core banking workflows and data requirements.
• Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, Synapse (Azure SQL DW), and Azure Data Lake.
• Perform data analysis and transformation using PySpark on Azure Databricks or Apache Spark.
• Design and implement data models optimized for storage and various query patterns.
• Work with structured, semi-structured, and unstructured data.
• Utilize various database technologies including Traditional RDBMS, MPP, and NoSQL.
• Ensure compliant handling and management of data.
• Experience in building end-to-end data pipelines in a cloud environment.
• Mentor junior engineers and contribute to the development of best practices and reusable frameworks.

Skills Expected :

(ref : hirist.tech)