Talent.com
Senior Data Engineer
Senior Data EngineerStraive • bhopal, India
Senior Data Engineer

Senior Data Engineer

Straive • bhopal, India
30+ days ago
Job description

Job Summary

We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver data products, and mentoring junior engineers.

Key Responsibilities

  • Design and build data pipelines using Apache Spark 3.x, Scala, Python, and SQL .
  • Tune Spark jobs for performance and cost.
  • Ensure code quality with unit tests, CI / CD, and code reviews.
  • Collaborate with platform and DevOps teams to deploy and monitor pipelines.
  • Troubleshoot production issues and perform root-cause analysis.

Qualifications

  • 5-8 years of experience as a Data Engineer .
  • Strong hands-on experience with Apache Spark 3.x .
  • Proficient in Scala, Python, and advanced SQL .
  • Experience with streaming frameworks (e.g., Spark Structured Streaming, Kafka).
  • Knowledge of orchestration tools (e.g., Apache Airflow).
  • Experience with cloud platforms like AWS Glue, EMR, Athena, Redshift, and S3 is a plus.
  • Solid understanding of software engineering fundamentals (Git, CI / CD).
  • Create a job alert for this search

    Senior Data Engineer • bhopal, India

    Related jobs
    Azure Databricks Engineer

    Azure Databricks Engineer

    Philodesign Technologies Inc • bhopal, India
    Job Opening : Azure Databricks Engineer (7+ Years Experience) | Budget : ₹1 LPM | Remote / Hybrid.We are seeking a highly skilled. This role is ideal for professionals who have deep expertise in buildin...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior ML Engineer

    Senior ML Engineer

    Torinit • bhopal, India
    Machine Learning Engineer (3–5 Years Experience).Canadian-based digital consulting company.At Torinit, we don't just serve our clients. we work with them to create transformative digital journeys b...Show more
    Last updated: 5 days ago • Promoted
    GCP Big Data Engineer (Full-time at a Fortune 500 tech MNC )

    GCP Big Data Engineer (Full-time at a Fortune 500 tech MNC )

    HARP • bhopal, India
    We are looking for an experienced and motivated.The ideal candidate will have 5 years of relevant experience in data engineering, with a strong focus on. This role requires strong technical expertis...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • bhopal, India
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 2 days ago • Promoted
    Xebia - Senior Azure Data Engineer

    Xebia - Senior Azure Data Engineer

    Xebia IT Architects India Pvt Ltd • Bhopal
    Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Forage AI • Bhopal, Madhya Pradesh, India
    Role Overview (Hands‑on Player‑Coach) This is a hands‑on leadership role.You will both lead and actively contribute code. You’ll work closely with engineers—reviewing designs and PRs, pairing o...Show more
    Last updated: 8 days ago • Promoted
    Senior Software Engineer Cloud Platform & Developer Enablement

    Senior Software Engineer Cloud Platform & Developer Enablement

    Applicantz • bhopal, India
    THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Partner with application teams to. Accelerate application onboarding.Troubleshoot platform integration issues...Show more
    Last updated: 21 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Beast Insights • bhopal, India
    We’re building the Payment Command Center for high-risk merchants — a platform that helps businesses recover failed payments, prevent chargebacks, and boost approval rates using data and intelligen...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • bhopal, India
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 2 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • bhopal, India
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Scientist

    Senior Data Scientist

    CO-WORKER TECHNOLOGY AB • bhopal, India
    Design, implement, and deploy predictive and prescriptive models using Python and Data-bricks.Define and implement best practices for data ingestion, cleaning, and feature engineering.Optimize Spar...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Data Science Engineer

    Senior Data Science Engineer

    Confidential • Bhopal, India
    INR 3000000-4000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Winmore). Note : This is a requirement for one of Uplers' client - Winmore).What...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Arenema • bhopal, India
    India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Staffingine LLC • bhopal, India
    The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Snowflake + DBT Engineer (8+ Years)

    Senior Snowflake + DBT Engineer (8+ Years)

    MindBrain • bhopal, India
    Job Opportunity : Snowflake + DBT Engineer.We are seeking a highly skilled Snowflake + DBT Engineer to design, build, and optimize scalable cloud-based data platforms. The ideal candidate will have s...Show more
    Last updated: 3 hours ago • Promoted • New!
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • bhopal, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer(Intern)

    Data Engineer(Intern)

    Tech Phoenix • bhopal, India
    Tech Phoenix is a data science and AI startup that delivers cutting-edge solutions to clients across industries.We take on challenging projects ranging from advanced analytics and machine learning ...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Ensemble Health Partners • bhopal, India
    Ensemble Health Partners India, we're at the forefront of innovation, leveraging cutting-edge technology to drive meaningful impact in the Revenue Cycle Management landscape.Our future-forward tech...Show more
    Last updated: 9 hours ago • Promoted • New!