Talent.com
Senior Data Engineer

Senior Data Engineer

People Prime WorldwideKottayam, IN
30+ days ago
Job description

We are seeking a highly skilled Senior Data Engineer with deep expertise in

Microsoft Azure data ecosystem to design, develop, and maintain scalable data

pipelines and architectures. The ideal candidate will play a key role in building robust

data solutions that support advanced analytics, BI, and AI workloads across the

organization. This role involves working with cross-functional teams — data scientists,

analysts, and business stakeholders — to ensure high-quality, secure, and performant

data delivery.

Total experience : 8 to 10 years

Key Responsibilities :

1. Data Architecture & Pipeline Development

  • Design, develop, and maintain data ingestion, transformation, and storage

pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.

  • Build end-to-end ETL / ELT workflows from diverse sources such as APIs, on-prem
  • databases, SaaS applications, and data lakes.

  • Implement data modeling (star schema, snowflake, data vault, etc.) for analytical
  • and operational data stores.

  • Manage data ingestion frameworks for both batch and streaming (real-time) use
  • cases using Azure Event Hubs / Azure Stream Analytics / Kafka.

    2. Data Management & Governance

  • Ensure data quality, consistency, and integrity across all environments.
  • Implement and enforce data governance standards, including metadata
  • management, lineage tracking, and data cataloging (e.g., Azure Purview).

  • Manage security, compliance, and access controls using Azure Active Directory
  • (AAD) and RBAC principles.

  • Automate data validation, auditing, and monitoring workflows using modern
  • DevOps practices.

    3. Cloud & DevOps Integration

  • Manage and optimize Azure Data Lake Storage (ADLS Gen2) for cost and
  • performance.

  • Leverage Infrastructure as Code (IaC) tools such as Terraform, Bicep, or ARM
  • templates for environment provisioning.

  • Implement CI / CD pipelines for data workflows using Azure DevOps / GitHub
  • Actions.

  • Optimize compute and storage costs while maintaining scalability and resilience.
  • 4. Collaboration & Leadership

  • Partner with data scientists, BI developers, and product teams to deliver reliable
  • data solutions.

  • Mentor junior data engineers on best practices, coding standards, and Azure
  • services.

  • Participate in architectural reviews and contribute to data platform design
  • decisions.

  • Communicate technical insights and trade-offs to non-technical stakeholders
  • effectively.

    Required Skills :

    Core Azure Services :

  • Azure Data Factory (ADF) – pipeline orchestration, triggers, linked services,
  • integration runtime.

  • Azure Databricks – PySpark, Delta Lake, notebooks, job orchestration.
  • Azure Synapse Analytics – dedicated and serverless SQL pools, data modeling,
  • query optimization.

  • Azure Data Lake Storage (ADLS Gen2) – hierarchical namespace, lifecycle
  • management.

  • Azure Functions / Logic Apps – event-driven data workflows.
  • Azure Event Hubs / Kafka / Stream Analytics – real-time data ingestion.
  • Programming & Tools :

    Strong in Python or Scala for data transformations.

    Proficient in SQL (T-SQL, Spark SQL, or Synapse SQL).

    Experience with PySpark for distributed data processing.

    Knowledge of Git, CI / CD, and DevOps best practices.

    Familiarity with Power BI integration or other reporting tools is a plus.Data Architecture & Modeling :

  • Expertise in data warehouse design, data lakehouse architecture, and data
  • pipelines.

  • Understanding of data partitioning, indexing, and query optimization
  • techniques.

  • Experience with dimensional modeling, slowly changing dimensions, and fact
  • tables.

    Other :

  • Experience with API-based data ingestion and RESTful integrations.
  • Exposure to machine learning data pipelines or feature stores is a plus.
  • Familiarity with cost optimization and performance tuning in Azure.
  • Soft Skills

    Excellent analytical and problem-solving abilities.

    Strong communication and documentation skills.

    Ability to work in an agile, fast-paced environment.

    Proven experience collaborating in cross-functional teams.

    Self-driven with a passion for data engineering and cloud technologies.

    Create a job alert for this search

    Senior Data Engineer • Kottayam, IN

    Related jobs
    • Promoted
    • New!
    Senior Data Engineer- Data modelling experience required

    Senior Data Engineer- Data modelling experience required

    COREDATA CONSULTANCYAlappuzha, IN
    We're looking for an experienced and dynamic.In this key role, you will be a hands-on architect, building secure and scalable data platforms while mentoring our engineering teams.Design and develop...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    lead Data Engineer

    lead Data Engineer

    CozzeraKottayam, IN
    Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKochi, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioKottayam, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 9 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Velodata Global Pvt LtdKerala, India, India
    First week in office, Remote / Hybrid.Trivandrum (Primary), Kochi (Secondary).SAP, Korber WMS, OpSuite ePOS, internal BI). Data Engineering / ETL Development.SSIS, SQL Server 2019 / 2022, T-SQL, stored ...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesKochi, IN
    Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Futran SolutionsKottayam, IN
    Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Azure Data Engineer (8+ Yrs)

    Senior Azure Data Engineer (8+ Yrs)

    Delphi Consulting Middle EastKottayam, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    People Prime WorldwideKottayam, IN
    Senior & Lead Data Engineer – Python & GCP.We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our dat...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Celebal TechnologiesKochi, IN
    We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Archite...Show moreLast updated: 9 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Alappuzha, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer [T500-21047]

    Senior Data Engineer [T500-21047]

    Deutsche BörseAlappuzha, IN
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyAlappuzha, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoKottayam, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIAlappuzha, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriAlappuzha, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    People Prime WorldwideKochi, IN
    We are seeking a highly skilled Senior Data Engineer with deep expertise in.Microsoft Azure data ecosystem to design, develop, and maintain scalable data. The ideal candidate will play a key role in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    AIQUAlappuzha, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechKottayam, IN
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsKottayam, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago