Talent.com
This job offer is not available in your country.
Estuate - GCP Data Engineer - Big Data

Estuate - GCP Data Engineer - Big Data

Estuate Software Pvt LtdHyderabad
12 days ago
Job description

Job Title : Data Engineer / Integration Engineer

Job Summary :

We are seeking a highly skilled Data Engineer / Integration Engineer to join our team. The ideal candidate will have expertise in Python, workflow orchestration, cloud platforms (GCP / Google BigQuery), big data frameworks (Apache Spark or similar), API integration, and Oracle EBS. The role involves designing, developing, and maintaining scalable data pipelines, integrating various systems, and ensuring data quality and consistency across platforms. Knowledge of Ascend.io is a plus.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and workflows.
  • Develop and optimize ETL / ELT processes using Python and workflow automation tools.
  • Implement and manage data integration between various systems, including APIs and Oracle EBS.
  • Work with Google Cloud Platform (GCP) or Google BigQuery (GBQ) for data storage, processing, and analytics.
  • Utilize Apache Spark or similar big data frameworks for efficient data processing.
  • Develop robust API integrations for seamless data exchange between applications.
  • Ensure data accuracy, consistency, and security across all systems.
  • Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
  • Collaborate with data analysts, engineers, and business teams to align data solutions with business goals.
  • Document data workflows, processes, and best practices for future reference.

Required Skills & Qualifications :

  • Strong proficiency in Python for data engineering and workflow automation.
  • Experience with workflow orchestration tools (e.g., Apache Airflow, Prefect, or similar).
  • Hands-on experience with Google Cloud Platform (GCP) or Google BigQuery (GBQ).
  • Expertise in big data processing frameworks, such as Apache Spark.
  • Experience with API integrations (REST, SOAP, GraphQL) and handling structured / unstructured data.
  • Strong problem-solving skills and ability to optimize data pipelines for performance.
  • Experience working in an agile environment with CI / CD processes.
  • Strong communication and collaboration skills.
  • Preferred Skills & Nice-to-Have :

  • Experience with Ascend.io platform for data pipeline automation.
  • Knowledge of SQL and NoSQL databases.
  • Familiarity with Docker and Kubernetes for containerized workloads.
  • Exposure to machine learning workflows is a plus.
  • Why Join Us?

  • Opportunity to work on cutting-edge data engineering projects.
  • Collaborative and dynamic work environment.
  • Competitive compensation and benefits.
  • Professional growth opportunities with exposure to the latest technologies.
  • ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Hyderabad

    Related jobs
    Big Data Engineer

    Big Data Engineer

    Saaki Argus & Averil ConsultingHyderabad, Telangana, India
    Quick Apply
    Notice Period : Immediate Joiner or 30 Day.Hands-on experience on technologies like.Hive, Scala, Spark, AWS, HBase.Proficient in Hadoop distributions such as. Good working experience on technologies...Show moreLast updated: 30+ days ago
    • Promoted
    Incedo - Data Engineer - Big Data

    Incedo - Data Engineer - Big Data

    Incedo Technology Solutions Ltd.Hyderabad
    We are looking for a skilled and passionate Data Engineer to join our growing team.The ideal candidate will be responsible for building scalable data pipelines, managing data workflows, and collabo...Show moreLast updated: 28 days ago
    • Promoted
    Egen - GCP Data Engineer

    Egen - GCP Data Engineer

    Egen.aiHyderabad
    About the Role : We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our dat...Show moreLast updated: 25 days ago
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy ServicesHyderabad, Telangana, India
    Required Technical Skill Set • •.Bigquery, Bigtable, Dataproc, Dataprep.Proven experience as a Subject Matter Expert in Google Cloud Storage or a similar role. In-depth knowledge of Google Cloud Platf...Show moreLast updated: 13 days ago
    Big Data Engineer

    Big Data Engineer

    RandomTreesHyderabad, Telangana, India
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 1 day ago
    • Promoted
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    SMARTWORK IT SERVICESHyderabad
    Job Title : GCP Data Engineer (Teradata Development) Mandatory Skills : GCP, Bigdata, ETL, Data warehousing, Pyspark, BigQuery <...Show moreLast updated: 30+ days ago
    • Promoted
    Excelra - Data Engineer - Big Data Technologies

    Excelra - Data Engineer - Big Data Technologies

    Excelra Knowledge Solutions Private LimitedHyderabad
    Data Engineer We are seeking a highly skilled and results-driven Data Engineer with expertise in PySpark, Python, and cloud-based data platforms (AWS / GCP) to join our...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Big Data Technologies

    Data Engineer - Big Data Technologies

    Talent SocioHyderabad
    Role Description : Candidate will be responsible for translating client requirements into design, architecting and implementing Cloud & Non Clo...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tech MahindraHyderabad, IN
    Remote (Must be available to work in U.We are searching for a mid-level Data Engineer who also has a strong skill set in data analysis. This person will be instrumental in developing, building, and ...Show moreLast updated: 25 days ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    Kresta Softech Private LimitedHyderabad, IN
    We’re looking for a skilled Big Data Engineer.Notice Period : Immediate / 15 days joiners Mandatory.Big Data, AWS, CI / CD Pipelines, Scala.Show moreLast updated: 21 days ago
    GCP Data engineer

    GCP Data engineer

    kyndrylINDIA
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward always pushing o...Show moreLast updated: 30+ days ago
    GCP Data Engineer

    GCP Data Engineer

    Multi RecruitHyderabad, IN
    Excellent Coding skills in ETLTools.Experience on running ETLpipelines from a wide variety of sources, both batch & streaming, usinglatest data frameworks and technologies with real time monitoring...Show moreLast updated: 30+ days ago
    Data Engineer- GCP

    Data Engineer- GCP

    NucleusTeqHyderabad, India, India
    Skills needed : Python, Airflow(Orchestration) ,GCP(Cloud),Spark SQL, PySpark, GCP, CI / CD ,Git,Git Hub.Designing and building data models to support business requirements. Developing and maintaining ...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer - GCP

    Senior Data Engineer - GCP

    bellfast management private limitedHyderabad
    Job Description : - Design, build, and maintain robust ETL pipelines using GCP and Ascend.Develop and optimize data processing jobs in Python and SQL...Show moreLast updated: 12 days ago
    GCP Data Engineer

    GCP Data Engineer

    5100 Kyndryl Solutions Private LimitedHyderabad, Telangana, India
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ...Show moreLast updated: 14 days ago
    GCP Big Data Engineer

    GCP Big Data Engineer

    Tiger AnalyticsChennai, Bangalore, Hyderabad
    Hoefler Text','Georgia',serif;font-style : italic;margin : 16px 0;padding : 10px 20px;}.Courier New',monospace,'Lucida Console'. }About the role : We are looking for a Senior Data Engineer to be based out o...Show moreLast updated: 30+ days ago
    Estuate Software - Data Engineer / Sr. Data Engineer

    Estuate Software - Data Engineer / Sr. Data Engineer

    NexthireHyderabad, India
    Job Title : Data Engineer / Sr.Experience Required : 5 to 12 years.Estuate is a global technology services company headquartered in California with development centers in India and Canada.We pr...Show moreLast updated: 11 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Technogen India Pvt. Ltd.Hyderabad, Telangana, India
    Hello Folks! We’re Hiring – Senior Data Engineer || Hyderabad ||.We are hiring for a product-based company for permanent roles! Join our innovative team and contribute to cutting-edge solutions.As ...Show moreLast updated: 16 days ago