Talent.com
Kafka Engineer

Kafka Engineer

EXLBengaluru, IN
6 hours ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Bengaluru, IN

    Related jobs
    • Promoted
    Senior Kubernetes Platform Engineer

    Senior Kubernetes Platform Engineer

    People Prime WorldwideBangalore, IN
    Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide.Our Engineering First approach ensures we can execute all ideas and creatively ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Apache Kafka Engineer

    Principal Apache Kafka Engineer

    ConfidentialBengaluru / Bangalore, India
    At BairesDev®, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our div...Show moreLast updated: 1 day ago
    • Promoted
    Kafka Developer

    Kafka Developer

    Stanley David And Associates (SDNA Global)Bangalore
    Job Description - Kafka Developer Role : Kafka Developer (Confluent) Band : B3 Show moreLast updated: 30+ days ago
    • Promoted
    Senior Kafka Data Engineer - Cloudera / Hadoop Ecosystem

    Senior Kafka Data Engineer - Cloudera / Hadoop Ecosystem

    VirtusaBangalore
    Description : Role Overview We are seeking a highly skilled Senior Kafka Data Engineer to design, build, and manage robust data pipelines that p...Show moreLast updated: 15 days ago
    • Promoted
    Engineer Kafka

    Engineer Kafka

    ANRGI TECH Pvt. Ltd.Bangalore, Karnataka, India
    CHENNAI PUNE HYDERABAD KOLKATA BANGALORE PAN India.Install configure and maintain Confluent and AWS MSK Kafka clusters.Manage large-scale multi-node Kafka cluster environments (on-prem and cloud).T...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Apache Kafka Engineer - Remote Work

    Principal Apache Kafka Engineer - Remote Work

    ConfidentialBengaluru / Bangalore, India
    Remote
    At BairesDev®, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our div...Show moreLast updated: 20 days ago
    • Promoted
    Digital Kafka

    Digital Kafka

    ConfidentialBengaluru / Bangalore
    Design, develop, and manage Kafka-based data pipelines.Ability to architect and create reference architecture for Kafka Implementations. Responsible for maintaining the availability, performance and...Show moreLast updated: 29 days ago
    • Promoted
    Kafka Administrator

    Kafka Administrator

    Human HorizonBangalore
    Description : Responsibilities : - Design, build, and manage Kafka clusters using the Confluent Platform for e...Show moreLast updated: 30+ days ago
    • Promoted
    Kafka Admin

    Kafka Admin

    ConfidentialBengaluru / Bangalore
    Stand up, configure, and administer on-premise Kafka clusters.Architect and create reference architecture and implementation standards for Kafka. Provide expertise in Kafka brokers, Zookeeper, Kafka...Show moreLast updated: 30+ days ago
    • Promoted
    Platform Engineer (Kafka)

    Platform Engineer (Kafka)

    ConfidentialBengaluru / Bangalore, India
    We are seeking a Platform Engineer with 3 4 years of experience working on Kafka in production environments.This role focuses on the deployment configuration monitoring and lifecycle management of ...Show moreLast updated: 20 days ago
    • Promoted
    Confluent Kafka and Flink Engineer

    Confluent Kafka and Flink Engineer

    XebiaBengaluru, Republic Of India, IN
    We’re seeking a hands-on engineer with deep expertise in Confluent Cloud Kafka and Apache Flink.Candidate should be able to design, build, and operate real-time streaming pipelines and analytics, w...Show moreLast updated: 27 days ago
    • Promoted
    Senior Apache Kafka Developer - Remote Work

    Senior Apache Kafka Developer - Remote Work

    ConfidentialBengaluru / Bangalore, India
    Remote
    At BairesDev®, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our div...Show moreLast updated: 20 days ago
    • Promoted
    Kafka Developer

    Kafka Developer

    ConfidentialBengaluru / Bangalore
    An experienced Confluent Kafka Administrator / Developer to assist us in managing and supporting our Kafka ecosystem.The ideal candidate will be working in strong collaboration with the Kafka team i...Show moreLast updated: 30+ days ago
    • Promoted
    Staff Apache Kafka Engineer - Remote Work

    Staff Apache Kafka Engineer - Remote Work

    ConfidentialBengaluru / Bangalore, India
    Remote
    At BairesDev®, we've been leading the way in technology projects for over 15 years.We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.Our div...Show moreLast updated: 8 days ago
    • Promoted
    Kafka / Confluent Kafka Admin

    Kafka / Confluent Kafka Admin

    Tata Consultancy ServicesBengaluru, Karnataka, India
    TCS is hiring for Kafka / Confluent Kafka Admin.Location : Chennai / Kolkata / Bangalore / Bhuvaneswar / Pune.Requires expertise in deploying, managing, and monitoring Kafka clusters, with a strong emphasis ...Show moreLast updated: 1 day ago
    • Promoted
    Kafka Administrator

    Kafka Administrator

    Korn FerryBangalore
    What you will be doing : - Kafka Administration and Support (Kafka / Streaming) - Architect, build and maintain Kafka cluster ...Show moreLast updated: 30+ days ago
    • Promoted
    Kafka Confluent Platform Engineer

    Kafka Confluent Platform Engineer

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    TCS is hiring for Kafka / Confluent Kafka Admin.Location : Chennai / Kolkata / Bangalore / Bhuvaneswar / Pune.Requires expertise in deploying, managing, and monitoring Kafka clusters, with a strong emphasis ...Show moreLast updated: 1 day ago
    • Promoted
    Confluent Kafka Integration Engineer / Consultant

    Confluent Kafka Integration Engineer / Consultant

    ConfidentialBengaluru / Bangalore, India
    We are seeking a skilled Kafka Integration Engineer with hands on experience in Confluent Kafka to join our data engineering team. The ideal candidate will be responsible for designing developing an...Show moreLast updated: 20 days ago