Talent.com
Kafka Engineer
Kafka EngineerEXL • guwahati, assam, in
No longer accepting applications
Kafka Engineer

Kafka Engineer

EXL • guwahati, assam, in
4 days ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • guwahati, assam, in

    Related jobs
    Full Stack Engineer (4-6 YOE)

    Full Stack Engineer (4-6 YOE)

    Redica Systems • guwahati, assam, in
    Redica Systems is a SaaS start-up serving more than 200 customers within the life science sector, with a specific focus on Pharmaceuticals and MedTech. Our workforce is distributed globally, with he...Show more
    Last updated: 20 hours ago • Promoted • New!
    Senior MLOps / DevOps Engineer

    Senior MLOps / DevOps Engineer

    Yubi • guwahati, assam, in
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the disco...Show more
    Last updated: 20 days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • guwahati, assam, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day ago • Promoted
    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Katonic AI • guwahati, assam, in
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Devops Engineer

    Senior Devops Engineer

    Datavid • guwahati, assam, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show more
    Last updated: 5 days ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • guwahati, assam, in
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 20 days ago • Promoted
    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    FICO • guwahati, assam, in
    FICO is seeking a Full-Stack observability Lead Engineer to design, maintain, and optimize our observability platform.The ideal candidate will be an expert in Open telemetry(Otel) instrumentation a...Show more
    Last updated: 18 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • guwahati, assam, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 12 hours ago • Promoted • New!
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • guwahati, assam, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    Vidhema Technologies • guwahati, assam, in
    Notice Period : Immediate Joiners Preferred.Cloud Platforms : Proficiency in AWS’s compute, storage, and networking services. Infrastructure as Code (IaC) and Configuration Management : .IaC Tools : Expe...Show more
    Last updated: 18 days ago • Promoted
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agility • guwahati, assam, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show more
    Last updated: 3 days ago • Promoted
    Senior Fullstack Engineer

    Senior Fullstack Engineer

    Black Dog Labs • guwahati, assam, in
    Senior Fullstack Engineer (with Data Engineering Experience).Remote (collaboration across time zones), India or LATAM preferred. Proficient English communication.Full-Stack Engineering / Backend Eng...Show more
    Last updated: 12 hours ago • Promoted • New!
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgemini • guwahati, assam, in
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show more
    Last updated: 4 days ago • Promoted
    Lead Coupa Architect – Source to Pay

    Lead Coupa Architect – Source to Pay

    Maitsys • guwahati, assam, in
    As part of the Digital Core Transformation team, you will design and implement Coupa and SAP S / 4HANA capabilities supporting global Procurement processes. The role requires experience in solution de...Show more
    Last updated: 5 days ago • Promoted
    Epicor Kinetic Dashboard Developer

    Epicor Kinetic Dashboard Developer

    Wisemonk • guwahati, assam, in
    Job Description : Epicor Kinetic Reports & Dashboard Developer.One of our US based client is looking for an experienced professional who can. The ideal candidate has hands-on expertise in Epicor’s re...Show more
    Last updated: 6 days ago • Promoted
    Senior CloudOps Engineer

    Senior CloudOps Engineer

    stackway • guwahati, assam, in
    Senior CloudOps Engineer | REMOTE | Experience : Minimum 5+ Years.At stackway, we help international enterprise software companies hire exceptional software engineers in India.Our mission is to buil...Show more
    Last updated: 12 hours ago • Promoted • New!
    Splunk to Grafana Migration Engineer

    Splunk to Grafana Migration Engineer

    Vista Applied Solutions Group Inc • guwahati, assam, in
    Splunk → Grafana Migration Engineer.Timeline : 11 / 24 / 2025-1 / 30 / 2026.Interviews : Thursday (20 / 11) & Friday (21 / 11). Working Hours : 1 : 30-9 : 30pm IST.Execute the migration of existing Splunk dashboards, ...Show more
    Last updated: 5 days ago • Promoted
    Coupa Administrator (Contractor)

    Coupa Administrator (Contractor)

    TekWissen India • guwahati, assam, in
    Title : Coupa Administrator (Contractor).Job Type : Temporary Assignment.TekWissen Group is a workforce management provider throughout the USA and many other countries in the world.We are seeking a s...Show more
    Last updated: 4 days ago • Promoted