Talent.com
Senior Data Engineer

Senior Data Engineer

Straivealappuzha, kerala, in
30+ days ago
Job description

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.

Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI / CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.

Qualifications

  • 5-8 years of experience as a Data Engineer .
  • Strong hands-on experience with Apache Spark 3.x .
  • Proficient in Scala, Python, and advanced SQL .
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI / CD).
    • Create a job alert for this search

    Senior Data Engineer • alappuzha, kerala, in

    Related jobs
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupAlappuzha, IN
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsAlappuzha, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdKottayam, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Senior GenAI Engineer

    Senior GenAI Engineer

    Mitra AIKottayam, IN
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansAlappuzha, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology InsightsKottayam, IN
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show moreLast updated: 10 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalAlappuzha, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiAlappuzha, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneAlappuzha, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersKollam, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, IncKottayam, IN
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FornaxKottayam, IN
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKollam, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    MindlanceKollam, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 10 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Alappuzha, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasKottayam, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Sr Data Engineer

    Sr Data Engineer

    Futran SolutionsKottayam, IN
    Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Capgemini InventAlappuzha, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show moreLast updated: 10 hours ago