Talent.com
Big Data Pipeline Engineer
Big Data Pipeline EngineerFlexton Inc. • Bengaluru, Republic Of India, IN
Big Data Pipeline Engineer

Big Data Pipeline Engineer

Flexton Inc. • Bengaluru, Republic Of India, IN
19 days ago
Job description

Role : Data Engineer (Spark | SQL | Big Data Pipelines)

Location : Bengaluru, India

Experience Neeeded : Spark, SQL, Data Streaming / Batch Processing, HDFS, Kafka Streaming

Note : We’re specifically looking for immediate joiners or candidates who are ready to start immediately or with a very short notice period. Must be Local to Bengalore and comfortable working on Hybrid Model.

About the Role

We are looking for a Data Engineer with 3–5 years of hands-on experience in building and optimizing data pipelines using Apache Spark and SQL . The ideal candidate will have a solid understanding of batch data processing, Data Streaming , data reliability, and performance optimization. You will collaborate with cross-functional teams to design scalable data solutions that support analytics and business objectives.

Must-Have Skills :

  • 3–5 years of hands-on experience with Apache Spark (including SparkSQL ).
  • Strong SQL expertise — ability to write complex, optimized queries.
  • Solid batch processing experience (scheduling, dependencies, performance tuning).
  • Good understanding of data pipeline architecture and fundamentals .
  • Experience handling structured and semi-structured data (CSV, JSON, Parquet).

Good to Have

  • Python or PySpark experience (not mandatory but preferred).
  • Exposure to data warehousing concepts and relational databases.
  • About Client :

    A global e-commerce leader enabling millions of buyers and sellers to connect across markets. The platform delivers secure, scalable, and data-driven marketplace experiences. Engineers here build solutions that shape the future of digital commerce through innovation in payments, logistics, AI, and customer experience.

    Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    Andor Tech • Bengaluru, Republic Of India, IN
    If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC. Work on cutting-edge big data solutions f...Show more
    Last updated: 21 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Bengaluru, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Arcana • Bengaluru, Republic Of India, IN
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    AppsForBharat • Bengaluru, Republic Of India, IN
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    LTIMindtree • Bengaluru, Republic Of India, IN
    Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions. Design develop and maintain sca...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Cargill • Bengaluru, Republic Of India, IN
    The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions,...Show more
    Last updated: 13 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Brillio • Bengaluru, Republic Of India, IN
    Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance. Implement data ETL processes for batch and streaming an...Show more
    Last updated: 1 day ago • Promoted
    Associate Data Pipeline Engineer

    Associate Data Pipeline Engineer

    Licious • Bengaluru, Republic Of India, IN
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Brillio • Bengaluru, Republic Of India, IN
    Brillio is a global digital technology company focused on delivering innovative solutions in data, AI, and cloud.With a strong presence across industries like banking, healthcare, and telecom, Bril...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    ACL Digital • Bengaluru, Republic Of India, IN
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
    Last updated: 20 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Cimpress India • Bengaluru, Republic Of India, IN
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    TEKsystems Global Services in India • Bengaluru, Republic Of India, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
    Last updated: 4 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Zluri • Bengaluru, Republic Of India, IN
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Zluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover iden...Show more
    Last updated: 19 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    L&T Technology Services • Bengaluru, Republic Of India, IN
    PySpark, SQL, AWS and good to have Pandas.Show more
    Last updated: 7 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Quess IT Staffing • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show more
    Last updated: 7 days ago • Promoted
    Big Data Pipeline Engineer

    Big Data Pipeline Engineer

    AMISEQ • Bengaluru, Republic Of India, IN
    Title : Data Engineer (Neo4j, JanusGraph).Neo4j, JanusGraph) and graph query languages - its must.Look for batch and real time streaming exp. Hadoop ecosystems such as Hive, Iceberg, Spark SQL.The Cl...Show more
    Last updated: 22 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Emids • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Infosys • Bengaluru, Republic Of India, IN
    As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, aud...Show more
    Last updated: 30+ days ago • Promoted