Talent.com
Estuate - GCP Data Engineer - Big Data
Estuate - GCP Data Engineer - Big DataEstuate Software Pvt Ltd • Hyderabad
Estuate - GCP Data Engineer - Big Data

Estuate - GCP Data Engineer - Big Data

Estuate Software Pvt Ltd • Hyderabad
30+ days ago
Job description

Job Title : Data Engineer / Integration Engineer

Job Summary :

We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP / Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and workflows.
  • Develop and optimize ETL / ELT processes using Python and workflow automation tools.
  • Implement and manage data integration between various systems, including APIs and Oracle EBS.
  • Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
  • Utilize Apache Spark or similar big data frameworks for efficient data processing.
  • Develop robust API integrations for seamless data exchange between applications.
  • Ensure data accuracy, consistency, and security across all systems.
  • Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
  • Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
  • Document data workflows, processes, and best practices for future reference.

Required Skills & Qualifications :

  • Strong proficiency in Python for data engineering and workflow automation.
  • Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).
  • Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
  • Expertise in big data processing frameworks, such as Apache Spark.
  • Experience with API integrations (REST, SOAP, GraphQL) and handling structured / unstructured data.
  • Strong problem-solving skills and ability to optimize data pipelines for performance.
  • Experience working in an agile environment with CI / CD processes.
  • Strong communication and collaboration skills.
  • Preferred Skills & Nice-to-Have :

  • Experience with Ascend.io platform for data pipeline automation.
  • Knowledge of SQL and NoSQL databases.
  • Familiarity with Docker and Kubernetes for containerized workloads.
  • Exposure to machine learning workflows is a plus.
  • Why Join Us?

  • Opportunity to work on cutting-edge data engineering projects.
  • Collaborative and dynamic work environment.
  • Competitive compensation and benefits.
  • Professional growth opportunities with exposure to the latest technologies.
  • (ref : hirist.tech)

    Create a job alert for this search

    Gcp Data Engineer • Hyderabad

    Related jobs
    GCP Data Engineer(Dataproc, Bigquery,)

    GCP Data Engineer(Dataproc, Bigquery,)

    Confidential • Hyderabad / Secunderabad, Telangana
    We are seeking an experienced GCP Data Engineer with expertise in Dataproc and BigQuery to join our team in India.The ideal candidate will have a strong background in designing and implementing dat...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Confidential • Kolkata, Hyderabad / Secunderabad, Telangana
    GCP Solution Architecture & Implementation : .Implement and architect data solutions on.End-to-End Data Pipeline Development : . Design and create end-to-end data pipelines using technologies like.Apach...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data engineer

    GCP Data engineer

    Tata Consultancy Services • Hyderabad, Telangana, India
    Greetings from Tata Consulting Services.TCS is Hiring for GCP Data engineer.GCP Data engineer, Pyspark, Data proc, Data flow.Show more
    Last updated: 30+ days ago • Promoted
    Big Data Engineer

    Big Data Engineer

    LiveRamp • Hyderabad, Republic Of India, IN
    LiveRamp is the data collaboration platform of choice for the world’s most innovative companies.A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is sett...Show more
    Last updated: 22 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Services • Hyderabad, Telangana, India
    Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Engineer - GCP

    Big Data Engineer - GCP

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer / Data Developer (GCP)

    Data Engineer / Data Developer (GCP)

    Tekshiras Software Services Private Limited • Hyderabad, Telangana, India
    Role : Data Engineer / Data Developer (GCP) Experience : 2–6 Years Location : Banglore and Pune Required Skills & Experience - Strong hands-on experience as a Data Engineer / Data Developer - Exper...Show more
    Last updated: 3 hours ago • Promoted • New!
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    People Prime Worldwide • Hyderabad, India
    Job Description – Lead GCP Data Engineer (Python + GCP).We are looking for an experienced Senior Data Engineer with strong skills in Python and Google Cloud Platform (GCP).You will design and ...Show more
    Last updated: 21 days ago • Promoted
    Cloud Data Architect - GCP Focus

    Cloud Data Architect - GCP Focus

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Hyderabad, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 15 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    E-Solutions • Hyderabad, IN
    Required Technical Skill Set : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Handson Experience on GCP.Should have worked on Data Migration projects, from On-prem to Cloud. Should have Cloud Storage K...Show more
    Last updated: 10 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Hyderabad, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 22 days ago • Promoted
    GCP Data Pipeline Engineer

    GCP Data Pipeline Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    We await your innovation at TCS : Hiring |.Greetings from TCS!! We are Hiring for.Required Experience : 5-10 years.Work location : Hyderabad, Chennai, Bangalore, Delhi. GCP, Big Query, Dataflow, Data P...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    SID Information Technologies • Hyderabad, Republic Of India, IN
    Role : Senior PostgreSQL Developer (DBT).Availability : Immediate Joiner.We are looking for a highly skilled Senior PostgreSQL Developer with strong DBT expertise to design, develop, and optimize hig...Show more
    Last updated: 2 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    JVG Consulting • Hyderabad, Telangana, India
    We believe in real-world problem-solving hands-on expertise and practical innovation over theoretical credentials.Google Cloud Platform (GCP) tools. The ideal candidate will be deeply familiar with ...Show more
    Last updated: 14 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • Hyderabad, IN
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 21 days ago • Promoted
    Gcp Data Engineer

    Gcp Data Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    We await your innovation at TCS : Hiring |.Greetings from TCS!! We are Hiring for.Required Experience : 5-10 years.Work location : Hyderabad, Chennai, Bangalore, Delhi. GCP, Big Query, Dataflow, Data P...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Hyderabad, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 14 days ago • Promoted