Talent.com
6767 | Kafka Engineer
6767 | Kafka EngineerEXL • gurugram, India
6767 | Kafka Engineer

6767 | Kafka Engineer

EXL • gurugram, India
14 hours ago
Job description

Job Title : Kafka Engineer (Java)

Experience : 5–8 Years

Job Summary :

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro / Protobuf).
  • Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines, deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.
  • Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy.
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • gurugram, India

    Related jobs
    Middleware Engineer (Rabbit MQ Messaging Engineer)

    Middleware Engineer (Rabbit MQ Messaging Engineer)

    FNZ • Gurugram, Haryana, India
    This is a new role in FNZ working within the wider Platform Infrastructure Services team and is technical in nature.You will be part of a team responsible for building and providing high quality ti...Show more
    Last updated: 17 days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    Yum! India Global Services Private Limited • Gurugram, Haryana, India
    Forming the Yum Digital Tech Team, you’ll be working across teams to support the DevOps of the Digital products for web and app as well as the integrations to the many external services.Your focus ...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    IGT Solutions • Gurugram, Haryana, India
    Job Description : DevOps Engineer (5+ Years’ Experience).Work mode : Remote & Hybrid Both.Notice period : Immediate Joiner only. Interested candidate share resume on.We are looking for an experienced.C...Show more
    Last updated: 2 days ago • Promoted
    Devops Engineer - Senior Lead

    Devops Engineer - Senior Lead

    Airtel Digital • Gurugram, Haryana, India
    Are you an ascending DevOps engineer seeking the summit of software development and deployment? Then consider joining Wynk Team. Interested to build the next generation Music and movies portal that ...Show more
    Last updated: 27 days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    GradRight Inc. • Gurugram, Haryana, India
    GradRight is the world’s first SaaS ecosystem that brings together students, universities and financial institutions on one platform. It enables students to find and fund high return college educati...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Cost Optimization Engineer

    Cloud Cost Optimization Engineer

    techjays • gurgaon, haryana, in
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show more
    Last updated: 12 days ago • Promoted
    Zoho Engineer

    Zoho Engineer

    ZoChord • Gurgaon, Haryana, India
    Zoho's suite of business applications, such as Zoho CRM, Zoho Creator, Zoho Inventory, and Zoho Books.Key duties include customising modules, creating and automating workflows, integrating Zoho wit...Show more
    Last updated: 30+ days ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    CitNOW Group • gurugram, uttar pradesh, in
    Founded in 2008, CitNOW is an innovative, enterprise-level software product suite that allows automotive dealerships globally to sell more vehicles and parts more profitably.CitNOW’s app-based plat...Show more
    Last updated: 30+ days ago • Promoted
    Senior Full Stack Engineer

    Senior Full Stack Engineer

    Shipsy • Gurugram, Haryana, India
    We are looking for a Full Stack Engineer (80% Backend, 20% Frontend) who loves building scalable systems and improving user experiences. You should get a rush from creating things from scratch and t...Show more
    Last updated: 3 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • gurugram, uttar pradesh, in
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 6 days ago • Promoted
    Senior Engineer - Cloud

    Senior Engineer - Cloud

    REA • Gurgaon, India
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?. Fast forward 30 years, REA Group is a market leader in...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    Binary Semantics Ltd. • Gurugram, Haryana, India
    Please find the below job description and reply me back with your updated resume at nirav.Job Description for DevOps Role. About Us : We are a client centric global software development company offer...Show more
    Last updated: 30+ days ago • Promoted
    L1 DevOps professional

    L1 DevOps professional

    Grassdoor • gurgaon, haryana, in
    L1 DevOps professional (Night Shift, Rotational).Remote (Night Shift, Rotational).At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Cen...Show more
    Last updated: 23 hours ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • gurgaon, haryana, in
    Senior AI-Integrated Software Engineer (.Remote until office reopens, Work from Home.We are looking for a dynamic and innovative. The ideal candidate will bring hands-on experience in AI-assisted de...Show more
    Last updated: 30+ days ago • Promoted
    Frappe / Erpnext Developer

    Frappe / Erpnext Developer

    Flowwolf • gurugram, uttar pradesh, in
    We suggest you enter details here.This is a full-time remote role for a Frappe / Erpnext Developer.The selected individual will design, develop, and customize modules on the Frappe / Erpnext framework ...Show more
    Last updated: 1 day ago • Promoted
    DevOps Engineer

    DevOps Engineer

    Digitem • Gurugram, Haryana, India
    DevOps Engineer (1+ Years Experience).Full-time | Gurugram | Immediate or 2–4 Week Joiners Preferred.We are looking for an outstanding DevOps Engineer who can work on automation, CI / CD, container o...Show more
    Last updated: 2 days ago • Promoted
    Lead Engineer - Cloud

    Lead Engineer - Cloud

    REA • Gurgaon, India
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : Can we change the way the world experiences property?. Fast forward 30 years, REA Group is a market leader in...Show more
    Last updated: 30+ days ago • Promoted
    Principal QA Engineer (Cypress)

    Principal QA Engineer (Cypress)

    CES • gurugram, uttar pradesh, in
    Design, develop, and maintain robust testing strategies and automation platforms.Author and execute functional test cases and automation scripts for complex features. Define and implement automation...Show more
    Last updated: 30+ days ago • Promoted