Talent.com
Data Pipeline Engineer (GCP)
Data Pipeline Engineer (GCP)Tata Consultancy Services • Bengaluru, Republic Of India, IN
Data Pipeline Engineer (GCP)

Data Pipeline Engineer (GCP)

Tata Consultancy Services • Bengaluru, Republic Of India, IN
22 days ago
Job description

Greetings from TCS!!!

Come and join us for an exciting career with TCS!!!

Role : GCP Data Engineer

Desired Experience Range : 5 -10 years

Location : Bangalore

Must Have Experiences and Skills :

Data Engineer

We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment.

Core Responsibilities

  • Design and Optimization : Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
  • Pipeline Development : Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
  • Big Data & Streaming : Implement and support Big Data solutions for both batch (scheduled) and real-time / streaming analytics.
  • Collaboration : Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.

Required Skills & Experience

  • Cloud Platform Expertise (GCP Focus) : Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically :
  • BigQuery : Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
  • Experience with other relevant GCP services like Cloud Storage , Cloud Dataflow / Beam , or Pub / Sub
  • Programming & Querying :
  • Python : Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
  • SQL : A solid command of advanced SQL for complex querying, data processing, and performance tuning.
  • Data Pipeline Orchestration : Prior experience using workflow management and orchestration tools (e.G., Apache Airflow , Cloud Composer, Airflow,Dagster, or similar).
  • DevOps / CI / CD : Experience with version control (Git) and familiarity with CI / CD practices and tools (e.G., GitLab, GitHub Actions) to automate deployment and testing processes.
  • Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Bengaluru, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Arcana • Bengaluru, Republic Of India, IN
    Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.Embark on a journey where your deep-rooted expertise in computer science fundamentals, a...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    AppsForBharat • Bengaluru, Republic Of India, IN
    We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business...Show more
    Last updated: 22 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Bangalore, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 22 days ago • Promoted
    GCP Data Pipeline Engineer

    GCP Data Pipeline Engineer

    Recruin • Bengaluru, Republic Of India, IN
    Experience Level : 5+ years in Looker along with the Bigquery.The Data Engineer will focus on preparing, validating, and ensuring the quality of data required. They will work on pipelines, transforma...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Cargill • Bengaluru, Republic Of India, IN
    The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions,...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Brillio • Bengaluru, Republic Of India, IN
    Brillio is a global digital technology company focused on delivering innovative solutions in data, AI, and cloud.With a strong presence across industries like banking, healthcare, and telecom, Bril...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Impetus • Bengaluru, Karnataka, India
    We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    ACL Digital • Bengaluru, Republic Of India, IN
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
    Last updated: 20 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    TEKsystems Global Services in India • Bengaluru, Republic Of India, IN
    Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL. Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show more
    Last updated: 4 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Cimpress India • Bengaluru, Republic Of India, IN
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Pipeline Engineer

    GCP Data Pipeline Engineer

    People Prime Worldwide • Bengaluru, India
    Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for...Show more
    Last updated: 21 hours ago • Promoted • New!
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Zluri • Bengaluru, Republic Of India, IN
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Zluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover iden...Show more
    Last updated: 18 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Bangalore, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 14 days ago • Promoted
    GCP Data Pipeline Engineer

    GCP Data Pipeline Engineer

    HCLTech • Bengaluru, Republic Of India, IN
    Available Location - Chennai, Bangalore, Hyderabad.Skills required : GCP, BigQuery, SQL, Python, Dataflow or Dataproc, Airflow or Cloud composer, DBT, Looker. Notice Period - Immediate joiner to 60 d...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Quess IT Staffing • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show more
    Last updated: 6 days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Emids • Bengaluru, Republic Of India, IN
    We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more
    Last updated: 19 hours ago • Promoted • New!
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Infosys • Bengaluru, Republic Of India, IN
    As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, aud...Show more
    Last updated: 30+ days ago • Promoted