Talent.com
Data Pipeline Specialist

Data Pipeline Specialist

Flexton Inc.Bengaluru, Republic Of India, IN
4 hours ago
Job description

Role : Data Engineer (Spark | SQL | Big Data Pipelines)

Location : Bengaluru, India

Experience Neeeded : Spark, SQL, Data Streaming / Batch Processing, HDFS

Note : We’re specifically looking for immediate joiners or candidates who are ready to start immediately or with a very short notice period. Must be Local to Bengalore and comfortable working on Hybrid Model.

About the Role

We are looking for a Data Engineer with 3–5 years of hands-on experience in building and optimizing data pipelines using Apache Spark and SQL . The ideal candidate will have a solid understanding of batch data processing , data reliability, and performance optimization. You will collaborate with cross-functional teams to design scalable data solutions that support analytics and business objectives.

Key Responsibilities

  • Design, build, and optimize data pipelines for ingestion, transformation, and loading (ETL / ELT).
  • Work extensively with Spark and SparkSQL for batch data processing.
  • Develop and maintain efficient SQL queries for large-scale data operations.
  • Monitor and troubleshoot pipeline performance, dependencies, and data quality issues.
  • Collaborate with analytics, data science, and business teams to ensure reliable and accessible data.

Must-Have Skills

  • 3–5 years of hands-on experience with Apache Spark (including SparkSQL ).
  • Strong SQL expertise — ability to write complex, optimized queries.
  • Solid batch processing experience (scheduling, dependencies, performance tuning).
  • Good understanding of data pipeline architecture and fundamentals .
  • Experience handling structured and semi-structured data (CSV, JSON, Parquet).
  • Good to Have

  • Python or PySpark experience (not mandatory but preferred).
  • Exposure to data warehousing concepts and relational databases.
  • About Client :

    A global e-commerce leader enabling millions of buyers and sellers to connect across markets. The platform delivers secure, scalable, and data-driven marketplace experiences. Engineers here build solutions that shape the future of digital commerce through innovation in payments, logistics, AI, and customer experience.

    Create a job alert for this search

    Data Pipeline Specialist • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    GCP Data Pipeline Specialist

    GCP Data Pipeline Specialist

    AwignBengaluru, Republic Of India, IN
    Only immediate joiner- Within 7-15 days.Chennai, Bangalore, Hyderabad, Pune (HYRBID).We are looking for an experienced.The ideal candidate will have strong hands-on experience with.Work closely wit...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Pipeline Specialist

    GCP Data Pipeline Specialist

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    GCP Big Query, Dataproc, Pub Sub, Airflow.Expertise in Google Data Engineering services – Big Query, Dataproc etc.Strong experience in programming languages such as Python, PySpark data manipulatio...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    AccoladeBengaluru, Republic Of India, IN
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    AI Pipeline Development Specialist

    AI Pipeline Development Specialist

    Sonata SoftwareBengaluru, Republic Of India, IN
    In today's market, there is a unique duality in technology adoption.On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefron...Show moreLast updated: 21 days ago
    • Promoted
    Principal Data Pipeline Specialist

    Principal Data Pipeline Specialist

    Societe Generale Global Solution CentreBengaluru, Republic Of India, IN
    With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors / inspectors with high-qua...Show moreLast updated: 13 days ago
    • Promoted
    GCP Data Pipeline Specialist

    GCP Data Pipeline Specialist

    JRD SystemsBengaluru, Republic Of India, IN
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 10 days ago
    • Promoted
    Azure Data Pipeline Specialist

    Azure Data Pipeline Specialist

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    Experience- 7 years to 14 years.Interested candidates can send their resume on below mail ID along with below details-.Education or career gap (if any) : . EP Reference Number (if already registered w...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Analyst

    Data Pipeline Analyst

    Zyoin GroupBengaluru, Republic Of India, IN
    Utilizing our Talend Tool to create jobs / pipelines, edit jobs / pipelines, and troubleshoot file / ingestion issues.Communicating and articulating issues with stakeholders, engineers, and our Partners....Show moreLast updated: 2 days ago
    • Promoted
    Data Pipeline Specialist

    Data Pipeline Specialist

    ConcentrixBengaluru, Republic Of India, IN
    Concentrix is a technology-enabled global business services company specializing in customer engagement and business performance. With more than 4,00,000 staff, Concentrix is present across 40 count...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Pipeline Developer

    Lead Data Pipeline Developer

    LiciousBengaluru, Republic Of India, IN
    We are seeking a highly skilled and experienced.SDE 3 – Data Platform Engineer.This role requires deep technical proficiency, architectural foresight, and strategic thinking to ensure our data syst...Show moreLast updated: 5 days ago
    • Promoted
    Data Pipeline Developer

    Data Pipeline Developer

    LTIMindtreeBengaluru, Republic Of India, IN
    Location : Any LTIMindtree location.Notice Period : Immediate to 90 Days.Extract transform and load ETL data from multiple sources ERP logistics compliance tools etc. Develop reusable data pipelines t...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    ACL DigitalBengaluru, Republic Of India, IN
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Cimpress IndiaBengaluru, Republic Of India, IN
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 24 days ago
    • Promoted
    Data Pipeline Specialist

    Data Pipeline Specialist

    TaggdBengaluru, Republic Of India, IN
    We are on the lookout for a skilled Datastage Developer to join our dynamic team! If you have a passion for data management and possess the ability to work with ETL processes, we want to connect wi...Show moreLast updated: 5 days ago
    • Promoted
    Data Pipeline Specialist

    Data Pipeline Specialist

    Grid DynamicsBengaluru, Republic Of India, IN
    Grid Dynamics (Nasdaq : GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital tra...Show moreLast updated: 2 days ago
    • Promoted
    Risk Data Pipeline

    Risk Data Pipeline

    ConfidentialBengaluru, Karnataka, India
    We are seeking a highly skilled.The ideal candidate will have strong programming expertise, hands-on experience with data engineering workflows, and a deep understanding of financial instruments an...Show moreLast updated: 2 days ago
    • Promoted
    Snowflake Data Pipeline Specialist

    Snowflake Data Pipeline Specialist

    PURVIEWBengaluru, Republic Of India, IN
    Designing, implementing, managing scalable data solutions using Snowflake environment for optimized data storage and processing. Migrate existing data domains / flows from relational data store to clo...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Sonata SoftwareBengaluru, Republic Of India, IN
    In today's market, we observe a distinct duality in technology adoption.On one front, clients are keenly focused on cost containment, while on the other, there is a strong drive to modernize their ...Show moreLast updated: 18 days ago