Talent.com
6767 | Kafka Engineer
6767 | Kafka EngineerEXL • guwahati, India
No longer accepting applications
6767 | Kafka Engineer

6767 | Kafka Engineer

EXL • guwahati, India
1 day ago
Job description

Job Title : Kafka Engineer (Java)

Experience : 5–8 Years

Job Summary :

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro / Protobuf).
  • Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines, deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.
  • Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy.
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • guwahati, India

    Related jobs
    DevOps Engineer

    DevOps Engineer

    CloudEagle.ai • guwahati, assam, in
    CloudEagle helps finance,operations & IT teams save on software spend and helps streamline the renewal and buying process. We have helped several companies like Iceye, Wefunder, Armory save 10-30% o...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior DevOps Engineer

    Senior DevOps Engineer

    CitNOW Group • guwahati, India
    Founded in 2008, CitNOW is an innovative, enterprise-level software product suite that allows automotive dealerships globally to sell more vehicles and parts more profitably.CitNOW’s app-based plat...Show more
    Last updated: 30+ days ago • Promoted
    Zoho Developer

    Zoho Developer

    White Tiger Connections Inc. • guwahati, assam, in
    Zoho as the backbone of our operations.We’re building a strong, reliable.We’re looking for a Zoho-experienced specialist who excels in systems design. You’ll own the configuration, automation, and i...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Full Stack Engineer

    Senior Full Stack Engineer

    OWOW • guwahati, assam, in
    Front-end technologies like ReactJS, Redux, TypeScript, Tailwind CSS.Exposure to other cloud platforms beyond AWS.Experience with microservices or event-driven architectures.Familiarity with AWS La...Show more
    Last updated: 25 days ago • Promoted
    MLOps Engineer — AWS SageMaker

    MLOps Engineer — AWS SageMaker

    Hadron Talent -Hadronfinsys • guwahati, assam, in
    MLOps Engineer — AWS SageMaker.A large global enterprise (name not disclosed).Full-time / Long-term contract.You will work within a global data & analytics team to design, deploy, and maintain robu...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • guwahati, India
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 1 day ago • Promoted
    AWS Solution Architect

    AWS Solution Architect

    Saxon AI • guwahati, assam, in
    We are looking for a highly skilled.Architecture & System Modernization.Own the redesign of the Truscan backend architecture : . Multi-stage compute pipeline (Stage 1–4).High-performance Python worker...Show more
    Last updated: 8 hours ago • Promoted • New!
    L1 DevOps professional

    L1 DevOps professional

    Grassdoor • guwahati, India
    L1 DevOps professional (Night Shift, Rotational).Remote (Night Shift, Rotational).At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Cen...Show more
    Last updated: 1 day ago • Promoted
    DevOps / Platform Engineer

    DevOps / Platform Engineer

    Tritonium • guwahati, assam, in
    Tritonium is an AI-powered SaaS platform that transforms app store reviews into actionable insights for mobile product teams. Our infrastructure processes millions of reviews, orchestrates AI analys...Show more
    Last updated: 8 hours ago • Promoted • New!
    Azure DevOps Data Engineer

    Azure DevOps Data Engineer

    Paritas Recruitment • guwahati, assam, in
    Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digital • guwahati, assam, in
    Responsible for designing and building backend system.Focus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences. Acts as a strong individual c...Show more
    Last updated: 30+ days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    UltraShip TMS • Guwahati, Assam, India
    Company Description The team at Ultraship is building a next-gen complete end-to-end Transportation Management System (TMS) that is used by top brokerage firms in Logistics industry.We are seeking ...Show more
    Last updated: 11 days ago • Promoted
    SAP BW / 4HANA Engineer

    SAP BW / 4HANA Engineer

    Yoda Tech • guwahati, India
    We are seeking a highly skilled.ABAP expertise to design, build, and optimize enterprise-grade data warehousing and analytics solutions. This role is hands-on and requires deep technical proficiency...Show more
    Last updated: 15 days ago • Promoted
    Sr Systems Engineer Linux – AI Infrastructure

    Sr Systems Engineer Linux – AI Infrastructure

    DC Tech Consulting • Guwahati, Assam, India
    Position : Senior Linux Administrator – AI / ML Infrastructure Location : Remote Experience : 5+ Years Type : Full-time Role Overview We are seeking a highly skilled Senior Linux Administrator to join...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    EXL • guwahati, assam, in
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    Insight Global • guwahati, assam, in
    We are seeking a skilled and experienced Senior Software Engineer specializing in DevOps.As a senior contributor responsible for creating, maintaining pipelines, automating scrips, and managing CI / ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • guwahati, assam, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Java Software Engineer

    Java Software Engineer

    Wenger & Watson • Guwahati, Assam, India
    Java+Big Data Work exp - 5 to 7 yrs Key Responsibilities Design, develop, and maintain Java-based data processing applications. Build and optimize Big Data pipelines using technologies such as ...Show more
    Last updated: 27 days ago • Promoted