Talent.com
Data Engineer-Data Platforms
Data Engineer-Data PlatformsConfidential • India, Cochin / Kochi / Ernakulam
Data Engineer-Data Platforms

Data Engineer-Data Platforms

Confidential • India, Cochin / Kochi / Ernakulam
24 days ago
Job description

Introduction

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your Role And Responsibilities

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support / guidance to project teams on complex coding, issue resolution and execution.

  • Your primary responsibilities include :
  • Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
  • Strive for continuous improvements by testing the build solution and working under an agile framework.
  • Discover and implement the latest technologies trends to maximize and build creative solutions

Preferred Education

Master's Degree

Required Technical And Professional Expertise

  • Experience with Apache Spark (PySpark) : In-depth knowledge of Spark's architecture, core APIs, and PySpark for distributed data processing.
  • Big Data Technologies : Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills : Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
  • Strong proficiency in Python : Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks : Knowledge of data processing libraries such as Pandas, NumPy.
  • SQL Proficiency : Experience writing optimized SQL queries for large-scale data analysis and transformation.
  • Cloud Platforms : Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
  • Preferred Technical And Professional Experience

  • Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
  • Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
  • Good to have detection and prevention tools for Company products and Platform and customer-facing
  • Skills Required

    Hadoop, Pyspark, Apache Spark, Data Warehousing, Kafka, hdfs , Data Modeling, Sql, Numpy, Pandas, Gcp, Azure, Python, Aws

    Create a job alert for this search

    Data Platform • India, Cochin / Kochi / Ernakulam

    Related jobs
    Data Engineer-Data Platforms-Google

    Data Engineer-Data Platforms-Google

    Confidential • India, Cochin / Kochi / Ernakulam
    In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sec...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Kochi, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Kochi, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Kochi, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Kochi, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Kochi, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Kochi, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Populace World Solutions • Kochi, Kerala, India
    Seeking a Data Engineer Lead with strong expertise in Databricks, PySpark, and cloud data engineering to modernize SAS-based applications into Python and Databricks-native solutions.Bachelor’s degr...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    BayOne Solutions • Kochi, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Kochi, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 15 days ago • Promoted
    Data Engineer-Data Platforms-Azure

    Data Engineer-Data Platforms-Azure

    Confidential • India, Cochin / Kochi / Ernakulam
    In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sec...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Kochi, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Kochi, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    American Inference • Kochi, IN
    Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. We are an AI and Data Consulti...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Kochi, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Kochi, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • Kochi, IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 22 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Kochi, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 8 days ago • Promoted