This job offer is not available in your country.

Senior Data Engineer

EXLThrissur, IN

24 days ago

Job description

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics .
Build and optimize lakehouse architectures on Azure using Delta Lake .
Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
Ensure data quality, consistency, and security across the data lifecycle.
Leverage Azure services such as Data Lake Storage Gen2 , Event Hubs , Azure Functions , and Key Vault .
Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
Optimize cloud resource usage for performance and cost-efficiency.
Design and implement star schema and other data modeling techniques to support analytical workloads.
Collaborate with analysts and data scientists to deliver advanced analytics solutions.
Conduct data quality assessments and contribute to data governance initiatives.
Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills

Expert-level experience with Azure Data Services : Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.

Strong proficiency in SQL for complex transformations and performance tuning.

Advanced Python skills for data pipeline development and orchestration.

Experience with Terraform or similar IaC tools for Azure.

Familiarity with CI / CD pipelines and DevOps practices.

Experience with containerization (Docker, Kubernetes) is a plus.

Strong understanding of data governance , security (RBAC, VNETs, Managed Identities) , and compliance in Azure.

Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs .

Soft Skills & Mindset

Growth mindset with a passion for continuous learning and innovation.

Strong collaboration skills across engineering, analytics, and business teams.

Robust client management skills

Structured problem-solving approach with a focus on scalability and maintainability.

Resilient under pressure with a solution-oriented attitude.

Excellent communication and documentation skills.

Preferred Qualifications

Microsoft Certified : Azure Data Engineer Associate or equivalent.

Experience with Delta Live Tables , Unity Catalog , or MLflow is a plus.

Familiarity with GCP or AWS is a bonus.

Create a job alert for this search

Senior Data Engineer • Thrissur, IN