Talent.com
Senior Data Engineer
Senior Data EngineerAppfabs Incorporation • Neyyattinkara, Thiruvananthapuram (district), India
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

Appfabs Incorporation • Neyyattinkara, Thiruvananthapuram (district), India
16 hours ago
Job description

About the Project :

We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You will be working closely with the customer to fill critical gaps in architecture, governance, security, and data product delivery, with a specific focus on Master Data Management (MDM) and comprehensive Data Quality .

What You'll Do (Responsibilities) :

As a Senior Data Governance & Platform Engineer, you will be a hands-on contributor across all facets of the project, specifically leading the implementation of master data and quality frameworks :

  • Platform Foundations (Reference Architecture & DataOps) : Collaborate on the design and implementation of a consolidated EDP reference architecture. You will be responsible for building out and hardening the platform’s core components using Azure Synapse, Azure Databricks, and Azure Data Lake Storage (ADLS). You will help define and implement a DataOps model, including CI / CD pipelines, environments, and observability.
  • Master Data Management (MDM) & Quality Leadership (NEW FOCUS) :

MDM Solutioning : Design, model, and configure the core components of the Master Data Management solution (Golden Record definition, matching / merging rules, hierarchy management) for critical domains (e.G., Customer, Product, Vendor).

Data Quality Automation : Define, implement, and monitor automated data quality checks (completeness, conformity, accuracy) directly within the ingestion and transformation pipelines (Bronze to Gold layers).

Data Quality Scorecards : Establish and maintain Data Quality scorecards and dashboards, reporting metrics to Data Stewards and business stakeholders via tools like Azure Purview.

  • Data Governance & Catalog : Support the operationalization of the full data governance framework. This includes implementing data classification policies, setting up data quality scorecards, and configuring the data catalog with ownership and lineage in a tool like Azure Purview.
  • Data Security & Access : Implement fine-grained access controls using patterns like Row-Level Security and Column-Level Security. You'll help design and apply a security model using Azure Entra ID groups and implement policy-as-code to protect PII.
  • Data Product Pipeline Factory : Build and maintain scalable and repeatable data pipelines to ingest, transform, and publish data from various sources. You will work on creating a standardized framework for data products, ensuring observability and adherence to established MDM and DQ standards.
  • Data Literacy & Change Management : Contribute to the enablement of data stewards, engineers, and analysts by providing practical, role-based training anchored to the data products and governance frameworks you build.
  • What We're Looking For (Required Skills & Experience) :

    We are seeking hands-on data engineers with a passion for building robust, well-governed, and secure data platforms. A strong candidate for this team will have :

  • Deep Azure Data Services Expertise : Proven, hands-on experience with the Azure data ecosystem : Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage (ADLS), and Azure Purview. Experience with Unity Catalog is highly desirable.
  • MDM & Data Quality Specialization :
  • Master Data Management : Practical experience designing and implementing MDM solutions, including experience with MDM concepts (match, merge, survive, hierarchy management) and familiarity with MDM platforms (e.G., Microsoft MDS).

    Data Quality Analyst Skills : Expertise in defining, implementing, and monitoring DQ rules. Strong ability to profile source data, identify data issues, and track metrics like data freshness, accuracy, and completeness.

  • Data Engineering Fundamentals : Strong background in data modeling (Dimensional, 3NF), ETL / ELT processes, and building scalable data pipelines for batch and streaming data. Knowledge of data warehousing and lakehouse architectures.
  • Programming & Scripting : Proficiency in Python and PySpark is essential for data transformation and pipeline development in Azure Databricks. Strong SQL skills are also required.
  • DevOps & CI / CD : Experience with DataOps principles, including setting up and maintaining CI / CD pipelines using tools like Azure DevOps or GitHub Actions. Familiarity with managing environments and infrastructure as code is a strong plus.
  • Data Governance & Security : Practical experience or a solid understanding of data governance concepts, including data quality, lineage, metadata management, and access control models (RBAC / ABAC).
  • Qualifications :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of progressive experience in a data engineering or data governance focused role.
  • Excellent problem-solving, analytical, and communication skills.
  • Demonstrated ability to work effectively in a collaborative and fast-paced environment.
  • Create a job alert for this search

    Senior Data Engineer • Neyyattinkara, Thiruvananthapuram (district), India

    Related jobs
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Trivandrum, Kerala, India
    Job Summary : BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support ...Show more
    Last updated: 14 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    IBS Software • Trivandrum, Kerala, India
    Trivandrum / Kochi / Chennai / Bangalore.We are seeking a talented AI Engineer to join our Data & AI Center of Excellence. You will join to build AI-first capabilities across IBS products and customer sol...Show more
    Last updated: 8 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Trivandrum, Kerala, India
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 14 days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Trivandrum, Kerala, India
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 9 days ago • Promoted
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    Techolution • Trivandrum, Kerala, India
    Remote
    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem. The ideal candidate will have a strong foundation ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Trivandrum, Kerala, India
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    ShimentoX Technologies • Trivandrum, Kerala, India
    Data Engineer (Strong with Building data connectors) Location : Remote Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL Job Description : 1. Must have proven background in...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Azure DevOps Data Engineer

    Azure DevOps Data Engineer

    Paritas Recruitment • Trivandrum, Kerala, India
    Azure DevOps (Data) Engineer - 6+ Month Rolling Contract Market Day Rate on offer Remote - (Sunday to Thursday working days) Location : Remote - 1 Week per quarter in Qatar Paritas is working wi...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • Trivandrum, Kerala, India
    K&K Talents is an international recruiting agency that has been providing technical resources globally since 1993.This position is with one of our clients in India , who is actively hiring candi...Show more
    Last updated: 1 day ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Lexoga • Trivandrum, Kerala, India
    We’re hiring for a market-leading edge computing startup that’s building AI infrastructure for remote and low-connectivity environments. Their mission is to power real-time, on-premise intelligence ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inference • Trivandrum, Kerala, India
    Note : Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.About the Compa...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    UST • Trivandrum, Kerala, India
    Senior Data Engineers Experience - 6 +Yrs (5-7 relevant years) Location : Trivandrum Mandatory Skill - Pyspark, SQL, Azure Databricks UK Shift Timing Job Description Key Accountabilities / Responsi...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Appfabs Incorporation • Trivandrum, Kerala, India
    We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP).This strategic initiative aims to mature their data and analytics capabilities across the organi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Trivandrum, Kerala, India
    Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Trivandrum, Kerala, India
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript Fully Remote - Long Term (initially 6 months) full time contract c$12. We have an immediate requirement for an experienced Data Eng...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • Trivandrum, Kerala, India
    About BI Connector BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Ou...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • Trivandrum, Kerala, India
    Remote
    We are hiring multiple Data Engineers to join international data platform, analytics, and cloud engineering teams.These fully remote, long-term freelance roles are ideal for engineers who can bui...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Trivandrum, Kerala, India
    Role : Data Engineer Location : Remote Shift Timing : 2 : 00 Pm - 11 : 00 Pm Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ) Must have skillset : GCP - 2 yea...Show more
    Last updated: 30+ days ago • Promoted