Talent.com
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

TekIT Software Solutions Pvt. Ltd. (India & USA)Mangalore, IN
9 days ago
Job description

Job Title : Senior Data Engineer

Employment Type : Full-Time

Location : Kochi / Trivandrum / Bangalore

Experience : Minimum 8 years

We are seeking a highly skilled Senior Data Engineer with strong expertise in Spark, Kafka, modern cloud platforms (AWS / GCP / Azure), ETL processes, SQL, and Databricks. The ideal candidate will have hands-on experience building scalable data pipelines, transforming raw data into curated datasets, and supporting large-scale replatforming initiatives across complex data ecosystems.

Key Responsibilities

1. Silver / Gold Layer Development

  • Transform raw data from various sources (Zuora, Commerce Tools, APIs, legacy databases) into curated Silver and Gold layers.
  • Implement business logic, data standardization, and robust data quality validations.
  • Collaborate with analysts / stakeholders to validate metric definitions and ensure consistency.

2. Replatforming Support

  • Audit and analyze existing pipelines for dependencies on legacy data structures.
  • Update data models and jobs to support new transactional systems.
  • Ensure end-to-end data lineage, compatibility with downstream analytics, and smooth migration.
  • 3. Collaboration & Documentation

  • Work closely with engineering, analytics, and product teams to document transformations and requirements.
  • Contribute to metadata tagging and data cataloging using Unity Catalog .
  • Develop comprehensive documentation : data dictionaries, PK / FK constraints, pipeline logic, validations, and process notes.
  • Must-Have Qualifications

  • Strong data modeling expertise using Kimball methodology .
  • Hands-on experience with Databricks (Workflows, DLTs, Delta Tables, Unity Catalog).
  • Strong proficiency in SQL and Python .
  • Solid understanding of Medallion Architecture (Bronze / Silver / Gold).
  • Experience with Spark , Kafka , ETL frameworks, and orchestration tools.
  • Proficiency in AWS / GCP / Azure cloud data services.
  • Hands-on experience with GitHub or similar version control systems.
  • Strong foundation in data governance , data quality frameworks, observability, and best practices.
  • Ability to collaborate effectively across multi-functional teams.
  • Preferred Qualifications

  • Experience in replatforming large-scale transactional systems.
  • Working knowledge or exposure to subscription and commerce data domains .
  • Create a job alert for this search

    Senior Data Engineer • Mangalore, IN

    Related jobs
    • Promoted
    Data Engineer – CDP

    Data Engineer – CDP

    Integers.AiMangalore, IN
    Job Description : Data Engineer – CDP.Data Engineer with strong CDP expertise.The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Sa...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesMangalore, IN
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiMangalore, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMangalore, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMangalore, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR TechMangalore, IN
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    BayOne SolutionsMangalore, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasMangalore, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdMangalore, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMangalore, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify SolutionsMangalore, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsMangalore, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    MindlanceMangalore, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsMangalore, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersMangalore, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 4 days ago
    • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek ConsultingMangalore, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionMangalore, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMangalore, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago