Talent.com
Senior Data Engineer

Senior Data Engineer

Appfabs Incorporationthiruvananthapuram, kerala, in
30+ days ago
Job description

About the Project :

We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP). This strategic initiative aims to mature their data and analytics capabilities across the organization. The project involves building a robust data platform, establishing a new operating model, and delivering foundational data products. You will be working closely with the customer to fill critical gaps in architecture, governance, security, and data product delivery, with a specific focus on Master Data Management (MDM) and comprehensive Data Quality .

What You'll Do (Responsibilities) :

As a Senior Data Governance & Platform Engineer, you will be a hands-on contributor across all facets of the project, specifically leading the implementation of master data and quality frameworks :

  • Platform Foundations (Reference Architecture & DataOps) : Collaborate on the design and implementation of a consolidated EDP reference architecture. You will be responsible for building out and hardening the platform’s core components using Azure Synapse, Azure Databricks, and Azure Data Lake Storage (ADLS). You will help define and implement a DataOps model, including CI / CD pipelines, environments, and observability.
  • Master Data Management (MDM) & Quality Leadership (NEW FOCUS) :

MDM Solutioning : Design, model, and configure the core components of the Master Data Management solution (Golden Record definition, matching / merging rules, hierarchy management) for critical domains (e.g., Customer, Product, Vendor).

Data Quality Automation : Define, implement, and monitor automated data quality checks (completeness, conformity, accuracy) directly within the ingestion and transformation pipelines (Bronze to Gold layers).

Data Quality Scorecards : Establish and maintain Data Quality scorecards and dashboards, reporting metrics to Data Stewards and business stakeholders via tools like Azure Purview.

  • Data Governance & Catalog : Support the operationalization of the full data governance framework. This includes implementing data classification policies, setting up data quality scorecards, and configuring the data catalog with ownership and lineage in a tool like Azure Purview.
  • Data Security & Access : Implement fine-grained access controls using patterns like Row-Level Security and Column-Level Security. You'll help design and apply a security model using Azure Entra ID groups and implement policy-as-code to protect PII.
  • Data Product Pipeline Factory : Build and maintain scalable and repeatable data pipelines to ingest, transform, and publish data from various sources. You will work on creating a standardized framework for data products, ensuring observability and adherence to established MDM and DQ standards.
  • Data Literacy & Change Management : Contribute to the enablement of data stewards, engineers, and analysts by providing practical, role-based training anchored to the data products and governance frameworks you build.
  • What We're Looking For (Required Skills & Experience) :

    We are seeking hands-on data engineers with a passion for building robust, well-governed, and secure data platforms. A strong candidate for this team will have :

  • Deep Azure Data Services Expertise : Proven, hands-on experience with the Azure data ecosystem : Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage (ADLS), and Azure Purview. Experience with Unity Catalog is highly desirable.
  • MDM & Data Quality Specialization :
  • Master Data Management : Practical experience designing and implementing MDM solutions, including experience with MDM concepts (match, merge, survive, hierarchy management) and familiarity with MDM platforms (e.g., Microsoft MDS).

    Data Quality Analyst Skills : Expertise in defining, implementing, and monitoring DQ rules. Strong ability to profile source data, identify data issues, and track metrics like data freshness, accuracy, and completeness.

  • Data Engineering Fundamentals : Strong background in data modeling (Dimensional, 3NF), ETL / ELT processes, and building scalable data pipelines for batch and streaming data. Knowledge of data warehousing and lakehouse architectures.
  • Programming & Scripting : Proficiency in Python and PySpark is essential for data transformation and pipeline development in Azure Databricks. Strong SQL skills are also required.
  • DevOps & CI / CD : Experience with DataOps principles, including setting up and maintaining CI / CD pipelines using tools like Azure DevOps or GitHub Actions. Familiarity with managing environments and infrastructure as code is a strong plus.
  • Data Governance & Security : Practical experience or a solid understanding of data governance concepts, including data quality, lineage, metadata management, and access control models (RBAC / ABAC).
  • Qualifications :

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of progressive experience in a data engineering or data governance focused role.
  • Excellent problem-solving, analytical, and communication skills.
  • Demonstrated ability to work effectively in a collaborative and fast-paced environment.
  • Create a job alert for this search

    Senior Data Engineer • thiruvananthapuram, kerala, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cokollam, kerala, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiKollam, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKollam, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansKollam, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneThiruvananthapuram, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsThiruvananthapuram, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersKollam, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American InferenceTrivandrum, Kerala, India
    Note : Please apply directly through LinkedIn for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.About the Compa...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Senior Data Engineer- Freelance

    Senior Data Engineer- Freelance

    Quapton AI SolutionsThiruvananthapuram, IN
    Quapton AI Solutions is an innovative tech startup dedicated to providing advanced IT services within the field of artificial intelligence. We aim to empower businesses with tailored AI-driven solut...Show moreLast updated: 19 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasKollam, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingKollam, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Appfabs IncorporationTrivandrum, Kerala, India
    We are engaging with a key customer to build and operationalize their Enterprise Data Platform (EDP).This strategic initiative aims to mature their data and analytics capabilities across the organi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKollam, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceKollam, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsThiruvananthapuram, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdKollam, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kollam, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer-IDMC

    Senior Data Engineer-IDMC

    Digivance SolutionsKollam, IN
    Data Ingestion, IDMC, Big Data Technology.We are seeking a skilled Data Engineer with strong experience in data ingestion, pipeline development, and working with cloud and big data technologies.The...Show moreLast updated: 5 hours ago