Senior Data Pipeline Engineer

Designation - Senior / Lead Data Engineer

Experience range - 5 to 10 Years

Job Location - Pune or Trivandrum

Job description

We are seeking a motivated Data Engineer with experience to design, develop, and maintain scalable data solutions on the Microsoft Azure platform. You will collaborate with cross-functional teams to enable data-driven decision-making using Azure Synapse Analytics, Data Factory, SQL, Python, and data analysis techniques. This role offers opportunities to grow your expertise in cloud data engineering while contributing to impactful projects.

________________________________________

Key Responsibilities

• Data Pipeline Development : Build, deploy, and maintain efficient ETL / ELT pipelines using Azure Data Factory and Azure Synapse Analytics.
• For Data Engineers, Databricks and Fabric should must have skills, with Synapse being a good-to-have addition.
• We are only looking for senior candidates with over 6 yrs of relevant exp with ample client facing exp.
• Finance / Insurance experience is also a must.
• Data Modeling & Warehousing : Design and optimize data models, warehouses, and lakes for structured / unstructured data.
• SQL & Query Optimization : Write complex SQL queries, optimize performance, and manage databases.
• Python Automation : Develop scripts for data processing, automation, and integration using Python (Pandas, NumPy).
• Collaboration : Partner with data analysts / scientists to ensure data accessibility and quality for analytics / ML projects.
• Data Analysis : Perform exploratory data analysis (EDA) to uncover trends, anomalies, and actionable insights.
• Troubleshooting : Resolve data pipeline issues, ensuring reliability and compliance with governance standards.
• Documentation : Maintain clear technical documentation for architectures, processes, and workflows.

Continuous Learning : Stay updated on Azure advancements (e.G., Databricks, Purview) and industry best practices.

Qualifications :