Talent.com
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

Matrimony.com LimitedChennai, Republic Of India, IN
10 days ago
Job description

Work Location : Chennai (Work From Office)

Department Overview

The Decision Support Systems (DSS) function enables data-driven decision-making across Matrimony.Com by delivering high-quality data pipelines, analytical platforms, and intelligent planning tools. The team partners with business leaders, product teams, and product engineering teams to convert raw data into actionable insights that power strategic, operational, and commercial decisions across the organization.

Role Overview :

We are seeking a Data Engineering Lead to drive the development and optimization of our enterprise data pipelines, analytical data models, and decision-support infrastructure at Matrimony.Com. In this role, you will design and build scalable ETL / ELT workflows, manage data lake and warehouse environments, and enable high-quality data availability for analytics, BI, and machine-learning use cases across the organization.

You will lead a small team of data engineers, collaborate closely with business stakeholders, BI analysts, and data science teams, and ensure strong engineering discipline in data modelling, orchestration, performance tuning, and governance.

Key Responsibilities :

  • Design and build scalable ETL / ELT pipelines using Python & Airflow / Prefect
  • Develop and optimize data lake, data warehouse, and data mart models
  • Build star / snowflake schemas, OLAP cubes, and analytical structures
  • Ensure data quality, validation, lineage, and documentation across pipelines
  • Partner with analytics & data science teams to enable ML-ready datasets
  • Monitor pipeline performance and drive improvements in reliability & cost
  • Guide and mentor a small team (2–3 engineers)
  • Collaborate with cross-functional partners to understand data needs and define solutions
  • Ensure adherence to data governance, access control, and security standards
  • Support BI teams with semantic layers, curated data sets, and performance tuning

Skill and Competencies :

  • 6–10 years of experience in data engineering
  • Strong Python + SQL + Airflow / Prefect
  • Experience with lake + warehouse + mart architectures
  • Hands-on dimensional modeling & OLAP systems
  • Spark / Kafka experience is a strong plus
  • Understanding of ML data pipelines & feature engineering workflows
  • Experience mentoring junior engineers and code reviewing
  • About Matrimony.Com

    Matrimony.Com Ltd, a Great Place to Work Certified Wed-Tech company listed on the BSE and NSE, is a leader in matchmaking and wedding services. Its flagship brand, Bharat Matrimony, is the largest and most trusted matrimony brand (Brand Trust Report 2014) spanning customers across the entire economic strata. The company serves over 8 million members with the support of 2,900+ associates and a network of 130+ company-owned retail outlets.

    Key Offerings

    Matchmaking Services :

  • BharatMatrimony and 200+ matrimony brands segmented on religion, languages, communities, and occupation.
  • Jodii : An exclusive matchmaking app for non-degree holders in 9 Indian languages
  • Assisted Service and EliteMatrimony : Personalised services for the HNI, NRI and Premium segment of customers
  • Wedding Services :

  • Wedding Bazaar : Largest wedding services provider.
  • Mandap.Com : Largest online wedding venues platform.
  • MakeMyWedding : Personalized & curated wedding planning services.
  • New Initiatives & Verticals

  • Astro Free Chat : It is an exclusive app for any astrology consultation
  • ManyJobs : Employment platform targeting grey collar workforce. In vernacular language for the Tamil Nadu market (initial phase) and with some of industry first features for both companies and candidates
  • Luv.Com : A next generation serious relationship app.
  • International Presence

    Matrimony.Com has successfully expanded into international markets, with UAE operations thriving for 4+ years and Bangladesh operations commencing in 2021. With a mission to dominate the $55 billion wedding services industry.

    Create a job alert for this search

    Data Pipeline Engineer • Chennai, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesIndia
    Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    AdastraNagpur, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MastekNagpur, IN
    Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show moreLast updated: 11 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedIndia, India
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneNagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma ConsultancyNagpur, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeIndia, India
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy TechnologiesIndia
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroIndia, India
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionNagpur, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HCLTechnagpur, maharashtra, in
    We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    SigmoidNagpur, IN
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Nagpur, IN
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Ubique SystemsIndia
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TEKsystems Global Services in IndiaNagpur, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Capgemini InventNagpur, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology InsightsNagpur, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 1 day ago