Talent.com
No longer accepting applications
Kafka Engineer

Kafka Engineer

EXLindore, madhya pradesh, in
1 day ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • indore, madhya pradesh, in

    Related jobs
    • Promoted
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgeminiindore, madhya pradesh, in
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 1 day ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Calyx Globalindore, madhya pradesh, in
    Calyx Global is a ClimateTech startup founded by Donna Lee and Duncan van Bergen, backed by Sequoia, Susquehanna (SIG), New Climate Ventures, and others. We provide ratings and research on the globa...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agilityindore, madhya pradesh, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show moreLast updated: 12 hours ago
    • Promoted
    SRE (Devops)

    SRE (Devops)

    Cozzeraindore, madhya pradesh, in
    Job Description : Senior SRE / DevOps Engineer.Night Shift (US East & West Coast Support).Excellent communication & collaboration skills. Manage and support production infrastructure during night shi...Show moreLast updated: 2 days ago
    • Promoted
    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    ezAIx Iinc.indore, madhya pradesh, in
    As part of our expansion, we’re seeking an.Advanced Senior DevOps Engineer.This critical role will drive the scalability of our platform, ensuring robust performance and high availability while emb...Show moreLast updated: 2 days ago
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Financeindore, madhya pradesh, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show moreLast updated: 16 days ago
    • Promoted
    Senior Enterprise Architect

    Senior Enterprise Architect

    Ironbook AIindore, madhya pradesh, in
    Develop Enterprise loud strategies, lead delivery teams in customer workshop, coordinate with multiple stakeholders in client hierarchy to engage, understand and articulate requirements to create s...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Groupindore, madhya pradesh, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    ezAIx Inc.indore, madhya pradesh, in
    As part of our expansion, we’re seeking an.Advanced Senior DevOps Engineer.This critical role will drive the scalability of our platform, ensuring robust performance and high availability while emb...Show moreLast updated: less than 1 hour ago
    • Promoted
    Splunk to Grafana Migration Engineer

    Splunk to Grafana Migration Engineer

    Vista Applied Solutions Group Incindore, madhya pradesh, in
    Splunk → Grafana Migration Engineer.Timeline : 11 / 24 / 2025-1 / 30 / 2026.Interviews : Thursday (20 / 11) & Friday (21 / 11). Working Hours : 1 : 30-9 : 30pm IST.Execute the migration of existing Splunk dashboards, ...Show moreLast updated: 2 days ago
    • Promoted
    DevOps Engineer

    DevOps Engineer

    SystemBenderindore, madhya pradesh, in
    Experienced DevOps engineer on AWS Cloud Platform and Azure Cloud Platform.Experienced DevOps engineer on GitHub, Jenkins, Nexus Repository, SonarQube and Fortify Scanner. Establish CI / CD pipeline f...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Cloud Operations Engineer (DevOps)

    Cloud Operations Engineer (DevOps)

    Suronexindore, madhya pradesh, in
    We’re expanding our team and looking for a skilled.Cloud Operations Engineer (DevOps).If you’re passionate about automation, infrastructure reliability, and modern cloud technologies, we’d love to ...Show moreLast updated: less than 1 hour ago
    • Promoted
    Lead Coupa Architect – Source to Pay

    Lead Coupa Architect – Source to Pay

    Maitsysindore, madhya pradesh, in
    As part of the Digital Core Transformation team, you will design and implement Coupa and SAP S / 4HANA capabilities supporting global Procurement processes. The role requires experience in solution de...Show moreLast updated: 2 days ago
    • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavidindore, madhya pradesh, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show moreLast updated: 2 days ago
    • Promoted
    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Radiant Systems Incindore, madhya pradesh, in
    As part of the Digital Core Transformation team, you will play a key role in designing and implementing Coupa and associated SAP S4HANA capabilities to support Procurement business processes.We are...Show moreLast updated: 2 days ago
    • Promoted
    Senior Workato Engineer

    Senior Workato Engineer

    TalentXM (Formerly BlockTXM Inc)indore, madhya pradesh, in
    The Senior Integration Engineer will design, develop, and implement automations &.This role will collaborate with.The ideal candidate will have a strong understanding of enterprise systems, APIs,.D...Show moreLast updated: 1 day ago
    • Promoted
    Senior Developer

    Senior Developer

    Virtusaindore, madhya pradesh, in
    Flexcube Application Developer Extension Development.Job SummaWe are seeking a skilled Flexcube Application Developer with handson experience in developing extensions and customizations for Oracle ...Show moreLast updated: 2 days ago
    • Promoted
    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    FICOindore, madhya pradesh, in
    FICO is seeking a Full-Stack observability Lead Engineer to design, maintain, and optimize our observability platform.The ideal candidate will be an expert in Open telemetry(Otel) instrumentation a...Show moreLast updated: 16 days ago