Talent.com
Kafka Engineer

Kafka Engineer

EXLAurangabad, IN
10 hours ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Aurangabad, IN

    Related jobs
    • Promoted
    GTM Engineer

    GTM Engineer

    FullFunnelAurangabad, IN
    At FullFunnel, we don’t believe growth should rely on manual grind—we believe in.That’s why we’re looking for a.This is not your average ops role. If you geek out on solving complex system puzzles a...Show moreLast updated: 30+ days ago
    • Promoted
    Zoho & Automation Specialist | Zoho, n8n, Zapier, Make

    Zoho & Automation Specialist | Zoho, n8n, Zapier, Make

    JkwebdesignAurangabad, IN
    We are seeking a highly skilled.The ideal candidate will have deep expertise with Zoho applications (CRM, Books, Desk, Projects, Creator, etc. You will play a key role in streamlining business proce...Show moreLast updated: 30+ days ago
    • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdgeAurangabad, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show moreLast updated: 16 days ago
    • Promoted
    Senior Kubernetes Platform Engineer

    Senior Kubernetes Platform Engineer

    People Prime WorldwideAurangabad, IN
    Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide.Our Engineering First approach ensures we can execute all ideas and creatively ...Show moreLast updated: 30+ days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    ScalantecAurangabad, IN
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Specialist QA Engineer – Jaipur

    Specialist QA Engineer – Jaipur

    Hawkvision AIAurangabad, IN
    Join HawkVision AI – Transforming Workplace Safety with Cutting-Edge Vision AI.Our real-time computer vision AI platform helps organizations visualize the unseen—detecting near misses, unsafe acts,...Show moreLast updated: 10 hours ago
    • Promoted
    Lear Corporation - Lead Engineer - Kafka

    Lear Corporation - Lead Engineer - Kafka

    Lear CorporationMaharashtra
    As a Lead Engineer, you will : - Design systems that deal with the scale of a billion messages per day Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupAurangabad, IN
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Manager-Capex

    Manager-Capex

    NouryonAurangabad, IN
    At Nouryon, our global team of Changemakers takes positive action every day, to reach higher goals collectively and individually. We create innovative and sustainable solutions for our customers to ...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansAurangabad, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneAurangabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
    • Promoted
    Technical Superintendent - Based in Cyprus

    Technical Superintendent - Based in Cyprus

    Comaea ConsultingMaharashtra, India, India
    Our client is one of the leading MNC in the maritime industry with a solid international client base and offices around the globe. To support the growth strategy and its expansion, our client is see...Show moreLast updated: 13 days ago
    • Promoted
    SAP Solutions Manager

    SAP Solutions Manager

    Tata Consultancy ServicesAurangabad, IN
    Responsible for SOLUTION MANAGER 7.Experience in Usage of Solution Manager in S / 4 HANA Implementation and Activate Methodology. Experience in Process Management in Solution Manager 7.Responsible for...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Lead Engineer - IBM Planning Analytics (TM1)

    Lead Engineer - IBM Planning Analytics (TM1)

    PepsiCoAurangabad, IN
    PepsiCo is embarked on a significant initiative of digitalization and standardization of the FP&A solution across all its divisions to make the finance organization more Capable, more Agile, and mo...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Observability Engineer(Dynatrace)

    Observability Engineer(Dynatrace)

    TEKsystemsAurangabad, IN
    Hands-on experience with design and implementation of observability frameworks.Dynatrace Managed and / or SaaS experience including hands on expertise with designing, instrumenting, and administering...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    CapgeminiAurangabad, IN
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Sr. Platform Engineer

    Sr. Platform Engineer

    CME GroupAurangabad, IN
    Join our Technology (DevOps) team as a Sr.In this critical role, you'll leverage your expertise in CI / CD, container orchestration (Kubernetes), and infrastructure-as-code to engineer the next gener...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiAurangabad, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago