Talent.com
Data Pipeline Engineer (GCP)

Data Pipeline Engineer (GCP)

Tata Consultancy ServicesBengaluru, Republic Of India, IN
16 days ago
Job description

Greetings from TCS!!!

Come and join us for an exciting career with TCS!!!

Role : GCP Data Engineer

Desired Experience Range : 5 -10 years

Location : Bangalore

Must Have Experiences and Skills :

Data Engineer

We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment.

Core Responsibilities

  • Design and Optimization : Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.
  • Pipeline Development : Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics
  • Big Data & Streaming : Implement and support Big Data solutions for both batch (scheduled) and real-time / streaming analytics.
  • Collaboration : Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.

Required Skills & Experience

  • Cloud Platform Expertise (GCP Focus) : Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically :
  • BigQuery : Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.
  • Experience with other relevant GCP services like Cloud Storage , Cloud Dataflow / Beam , or Pub / Sub
  • Programming & Querying :
  • Python : Expert-level programming proficiency in Python, including experience with relevant data engineering libraries
  • SQL : A solid command of advanced SQL for complex querying, data processing, and performance tuning.
  • Data Pipeline Orchestration : Prior experience using workflow management and orchestration tools (e.G., Apache Airflow , Cloud Composer, Airflow,Dagster, or similar).
  • DevOps / CI / CD : Experience with version control (Git) and familiarity with CI / CD practices and tools (e.G., GitLab, GitHub Actions) to automate deployment and testing processes.
  • Create a job alert for this search

    Data Pipeline Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTechBangalore, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Data Engineer with Databricks & GCP

    Data Engineer with Databricks & GCP

    iitjobs, Inc.hosur, tamil nadu, in
    Role : - Data Engineer with Databricks & GCP.Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark. Expertise in SQL and advanced query optimization.Proficiency ...Show moreLast updated: 22 hours ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyanthosur, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intelliashosur, tamil nadu, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen IncBengaluru, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show moreLast updated: 8 days ago
    • Promoted
    GCP data Engineer

    GCP data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M / R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. Must have : Operating knowledge of cloud co...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    We are looking for an experienced.The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and analytics solutions that drive business insights.Design...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    AdastraBengaluru, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 3 days ago
    • Promoted
    GCP Data engineer

    GCP Data engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Greetings from Tata Consulting Services.TCS is Hiring for GCP Data engineer.GCP Data engineer, Pyspark, Data proc, Data flow.Show moreLast updated: 11 days ago
    • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    ImpetusBengaluru, Karnataka, India
    Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark).You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform.You will manage a team of ...Show moreLast updated: 25 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resourceshosur, tamil nadu, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 14 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 24 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limitedhosur, tamil nadu, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer (Snowflake+ DBT)

    Senior Data Engineer (Snowflake+ DBT)

    Anblickshosur, tamil nadu, in
    Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner. We are looking for a highly skilled.ELT pipelines and analytical data ...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careershosur, tamil nadu, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindrahosur, tamil nadu, in
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 22 hours ago