Talent.com
Associate Data Pipeline Engineer

Associate Data Pipeline Engineer

LiciousBengaluru, Republic Of India, IN
20 hours ago
Job description

SDE 1 – Data Platform Engineer

Overview

We are looking for a passionate and motivated Software Development Engineer (SDE 1) – Data Platform to join our growing Data Platform Engineering team at Licious .

In this role, you’ll design, build, and optimize data systems and pipelines that fuel analytics, reporting, and data-driven decision-making across the organization. You’ll work on modern data platforms, collaborate with experienced engineers, and gain hands-on exposure to cutting-edge data and cloud technologies.

This opportunity is ideal for someone who enjoys solving complex data problems, working with large-scale systems, and continuously learning in a fast-paced, high-impact environment.

What You’ll Do

Data Pipelines & Infrastructure

  • Design and develop scalable ETL / ELT pipelines and workflows using orchestration tools such as Airflow, Azkaban, or Luigi .
  • Build batch and real-time data processing systems using technologies like Apache Spark, Flink, Kafka, and Debezium .
  • Implement data quality, observability, and lineage frameworks to ensure reliable, accurate, and trusted data delivery.

Data Management & Optimization

  • Develop and maintain data ingestion, transformation, and storage layers using modern data lake and warehouse platforms ( AWS S3, Redshift, Snowflake, Databricks ).
  • Write and optimize SQL queries and data models to support analytical and reporting workloads.
  • Collaborate with senior engineers to enhance system performance, scalability, and cost efficiency .
  • Collaboration & Delivery

  • Partner with data analysts, ML engineers, and product teams to translate business needs into scalable data solutions.
  • Work closely with platform and DevOps teams to ensure secure, efficient, and automated data operations.
  • Participate in code reviews , maintain high-quality documentation, and follow software engineering best practices .
  • Continuous Learning

  • Stay updated with emerging data technologies, frameworks, and cloud solutions .
  • Contribute to initiatives in data standardization, governance, and automation to strengthen the organization’s data foundation.
  • What You’ll Bring

    Technical Skills :

  • Strong understanding of data engineering fundamentals — ETL / ELT design, data modeling, warehousing, and lake architectures.
  • Hands-on experience with one or more data technologies such as Spark, Kafka, or Airflow .
  • Proficiency in Python, Java, or Scala for data engineering and automation tasks.
  • Strong SQL skills and familiarity with relational databases (e.G., MySQL, PostgreSQL ).
  • Exposure to cloud environments , preferably AWS , including services like S3, Glue, Redshift, EMR .
  • Foundational Knowledge :

  • Understanding of software engineering practices — version control (Git), testing, CI / CD, and documentation.
  • Basic awareness of data governance, observability, and quality monitoring concepts.
  • Soft Skills :

  • Strong analytical thinking and problem-solving mindset.
  • Collaborative and eager to learn from experienced mentors.
  • Detail-oriented, reliable, and driven to build scalable, high-performance systems.
  • Preferred Qualifications :

  • Experience or exposure to data lakehouse architectures .
  • Familiarity with containerization (Docker) and orchestration (Kubernetes) .
  • Understanding of MLOps, data observability, or data catalog frameworks .
  • Prior experience in high-growth, consumer-tech, or digital-first environments .
  • Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.Bengaluru, Karnataka, India
    Virtual interview : 25-Oct-2025.Data Software Engineer - Spark, Python, (Azure Databricks ).Years of in Big Data & Data related technology experience. Expert level understanding of distributed comput...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    ArcanaBengaluru, Republic Of India, IN
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyanthosur, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 5 days ago
    • Promoted
    Azure Data Pipeline Specialist

    Azure Data Pipeline Specialist

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    We await your innovation at TCS : Hiring |.Greetings from TCS!! We are Hiring for Azure Data Engineer.Required Experience : 8-12 years. Work location : Chennai, Bangalore.Required technical Skills : Azu...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Pipeline Engineer (AWS)

    Data Pipeline Engineer (AWS)

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Required Skill Set : AWS...Show moreLast updated: 20 hours ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    ANSRBengaluru, Republic Of India, IN
    To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.American Airlin...Show moreLast updated: 16 days ago
    • Promoted
    Cloud Data Pipeline Engineer

    Cloud Data Pipeline Engineer

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 30+ days ago
    • Promoted
    Associate - Data and Analytics

    Associate - Data and Analytics

    ConfidentialBengaluru / Bangalore, India
    If you are a strategic thinker with a passion for driving solutions in quantitative analytics, you have found the right team. As a Quantitative Analytics Professional within our Consumer & Community...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Ubique SystemsBengaluru, Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer - Associate

    Data Engineer - Associate

    ConfidentialBengaluru / Bangalore, India
    AQR is a global investment management firm built at the intersection of financial theory and practical application.We strive to deliver superior, long-term results for our clients by seeking to fil...Show moreLast updated: 22 days ago
    • Promoted
    DNEG - Senior Pipeline Engineer - Data Analytics

    DNEG - Senior Pipeline Engineer - Data Analytics

    ConfidentialBengaluru / Bangalore, India
    Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accel...Show moreLast updated: 22 days ago
    • Promoted
    Associate - Data Engineer

    Associate - Data Engineer

    ConfidentialBengaluru / Bangalore, India
    INR 16,00,000 - 24,00,000 / year.Collaborate with data scientists (who typically work with Python) to design and help build automated, deployable solutions using data orchestration tools (like AirF...Show moreLast updated: 15 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    Greetings from Tata Consultancy Services!!.Data Engineer - GCPSQL + PySpark.MS with minimum 3 years of relevant IT-experience post Qualification. Only Full-Time courses would be considered.Candidate...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Real-time Data Pipeline Engineer

    Real-time Data Pipeline Engineer

    VIDA Digital IdentityBengaluru, Republic Of India, IN
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show moreLast updated: 20 hours ago
    • Promoted
    Risk Data Pipeline

    Risk Data Pipeline

    ConfidentialBengaluru, Karnataka, India
    We are seeking a highly skilled.The ideal candidate will have strong programming expertise, hands-on experience with data engineering workflows, and a deep understanding of financial instruments an...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Data Pipeline Engineer (Azure)

    Senior Data Pipeline Engineer (Azure)

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 20 hours ago
    • Promoted
    Associate Data Engineer - Collibra / Alation

    Associate Data Engineer - Collibra / Alation

    TeamWare SolutionsBangalore
    We are seeking an Associate Data Engineer to support data engineering and management initiatives.This role involves developing data solutions, conducting quality checks, and collaborating with team...Show moreLast updated: 30+ days ago
    • Promoted
    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR 50 L

    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR 50 L

    CareerXperts ConsultingBangalore, Bangalore (district)
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 5 days ago