Talent.com
Senior Data Engineer
Senior Data EngineerStraive • mount, kerala, in
Senior Data Engineer

Senior Data Engineer

Straive • mount, kerala, in
30+ days ago
Job description

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.

Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI / CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.

Qualifications

  • 5-8 years of experience as a Data Engineer .
  • Strong hands-on experience with Apache Spark 3.x .
  • Proficient in Scala, Python, and advanced SQL .
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI / CD).
  • Create a job alert for this search

    Senior Data Engineer • mount, kerala, in

    Related jobs
    Big Data Engineer - Hadoop / Hive

    Big Data Engineer - Hadoop / Hive

    HARP Technologies and Services • Kerala
    Description : - Skill : Bigdata + Pyspark - Location : Hyder...Show more
    Last updated: 22 days ago • Promoted
    Structural Design Engineer

    Structural Design Engineer

    Interarch Building Solutions Limited • Kerala, India, India
    Interarch Building Solutions Limited.Job Title : Design Engineer / Sr.Design Engineer - Pre-Engineered Buildings (PEB).Industry : Pre-Engineered Steel Buildings (PEB). We are seeking a talented and ex...Show more
    Last updated: 10 days ago • Promoted
    Part Time -Senior Oracle BPM Devleoper

    Part Time -Senior Oracle BPM Devleoper

    Abidott Solutions (OPC) Private Limited • Kerala, India, India
    We are seeking an experienced Senior Oracle BPM Developer to design, develop, and optimize enterprise-grade BPM solutions. The ideal candidate will have deep expertise in Oracle BPM Suite, middlewar...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • mount, kerala, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digital • mount, kerala, in
    We are looking Remotly for Senior Java Developer for permanent role.Experience : 5 Years to 8 Years.Notice Period : Immediate(Next Day joiner only). We are seeking a highly skilled and experienced.The...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Programmers.io • mount, kerala, in
    Job Title : Senior Full Stack Developer (Laravel + Vue).We are seeking highly skilled Senior Full Stack Developers with 7–10 years of experience in Laravel and modern frontend frameworks (Vue.The ca...Show more
    Last updated: 13 days ago • Promoted
    Senior / Lead Data Engineer - AWS / Python

    Senior / Lead Data Engineer - AWS / Python

    Velodata Global Pvt Ltd • Kerala
    Job Title : Lead Data Engineer Location : Kochi / Trivandrum Experience : 10+ years No...Show more
    Last updated: 30+ days ago • Promoted
    SSE– API Automation

    SSE– API Automation

    Staffington Global • Kerala, India, India
    Senior Software Engineer – API Automation.Automation testing, Python, Pandas, Selenium, GEN AI, Dataframeworks.Kochi(Prefer Candidates from Kerala). Immediate joiners or within 15–30 days.Show more
    Last updated: 4 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • mount, kerala, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 16 days ago • Promoted
    Senior Data Architect - Snowflake

    Senior Data Architect - Snowflake

    Reflections Info Systems • Kerala, India, India
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show more
    Last updated: 8 days ago • Promoted
    Data Analyst / Business Analyst

    Data Analyst / Business Analyst

    ACL Digital • mount, kerala, in
    Data Analyst / Business Analyst.Strong working knowledge of healthcare domains such as.Claims, Member, Provider, and Encounter data. Strong analytical skills with the ability to interpret data, iden...Show more
    Last updated: 14 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • mount, kerala, in
    Job Description : AI / ML Engineer (3D Geometry & Manufacturing).We are seeking an exceptionally talented and entrepreneurial. Design for Manufacturability (DFM).If you are passionate about leveraging ...Show more
    Last updated: 30+ days ago • Promoted
    ETL Testing(SQL+Bigquery)

    ETL Testing(SQL+Bigquery)

    UST • Kerala, India, India
    We are looking for a meticulous and proactive ETL Tester to ensure the accuracy, reliability, and performance of data pipelines built on Google Cloud Platform. This role involves validating ETL work...Show more
    Last updated: 21 days ago • Promoted
    Senior SQL Developer

    Senior SQL Developer

    Programmers.io • mount, kerala, in
    Job Title : : Senior SQL Developer.Experience Range : 6 to 12 Years.Shift Time : 2 : 30 PM to 11 : 30 PM IST.Must have skills set C#, SQL Server &. Good to have skills Set : Finance Background.Design, devel...Show more
    Last updated: 22 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Insight Global • mount, kerala, in
    Duration : 6 month contract with potential to convert permanent.JS; primary codebase is frontend-heavy.Proficient with Git for source code management. Hands on experience with AWS Elastic Beans, EC2,...Show more
    Last updated: 30+ days ago • Promoted
    Technical Cofounder Ruka.live

    Technical Cofounder Ruka.live

    Hotline App Private LTD • Kerala, India, India
    Looking for a Technical Cofounder for Ruka (AI Voice Sales Agent).We’ve built a fully autonomous AI voice-calling sales agent that can do cold calling, lead outreach, and instant inbound follow-ups...Show more
    Last updated: 13 days ago • Promoted
    Data Analyst

    Data Analyst

    Nonrel Technologies • mount, kerala, in
    Nonrel Technologies is a leading IT software company dedicated to transforming businesses through innovative, scalable, and secure software solutions. We specialize in custom software development, c...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    American Inference • Kerala, India, India
    Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. We are an AI and Data Consulti...Show more
    Last updated: 21 days ago • Promoted