Talent.com
Kafka Engineer

Kafka Engineer

EXLGulbarga, IN
1 day ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Gulbarga, IN

    Related jobs
    • Promoted
    ETL Architect

    ETL Architect

    Tata Consultancy ServicesGulbarga, IN
    Notice period- 0 to 6 o Days or Serving NP.Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.Data Warehou...Show moreLast updated: 1 day ago
    • Promoted
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC GroupGulbarga, IN
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Kubernetes Network Engineer

    Senior Kubernetes Network Engineer

    World Wide TechnologyGulbarga, IN
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneGulbarga, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    ScalantecGulbarga, IN
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 3 days ago
    • Promoted
    Cloud Cost Optimization Engineer

    Cloud Cost Optimization Engineer

    techjaysGulbarga, IN
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 1 day ago
    • Promoted
    Specialist QA Engineer – Jaipur

    Specialist QA Engineer – Jaipur

    Hawkvision AIGulbarga, IN
    Join HawkVision AI – Transforming Workplace Safety with Cutting-Edge Vision AI.Our real-time computer vision AI platform helps organizations visualize the unseen—detecting near misses, unsafe acts,...Show moreLast updated: 1 day ago
    • Promoted
    Zoho & Automation Specialist | Zoho, n8n, Zapier, Make

    Zoho & Automation Specialist | Zoho, n8n, Zapier, Make

    JkwebdesignGulbarga, IN
    We are seeking a highly skilled.The ideal candidate will have deep expertise with Zoho applications (CRM, Books, Desk, Projects, Creator, etc. You will play a key role in streamlining business proce...Show moreLast updated: 30+ days ago
    • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTechGulbarga, IN
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show moreLast updated: 30+ days ago
    • Promoted
    Confluent Engineer

    Confluent Engineer

    Optimum Solutions Pte LtdGulbarga, IN
    Confluent Kafka, Terraform, CDC-Change Data Capture, Microservices, Kafka Connect, Kafka Streams, and Schema Registry.Integrate CDC pipelines with core banking applications, databases, and enterpri...Show moreLast updated: 1 day ago
    • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    VDEXGulbarga, IN
    VDEX is a rapidly-growing perpetual exchange powered by zero knowledge state channels.The exchange recently surpassed $2 billion in volume and is incubated by Binance Labs.Responsibilities and Requ...Show moreLast updated: 3 days ago
    • Promoted
    Senior / Staff Full‑Stack Engineer — CEO’s Build Partner (AI‑Augmented)

    Senior / Staff Full‑Stack Engineer — CEO’s Build Partner (AI‑Augmented)

    TrueyGulbarga, IN
    Senior / Staff Full‑Stack Engineer — CEO’s Build Partner (AI‑Augmented) 🚀.C2C with your own LLC considered; NO staffing vendors — direct to Truey. You’ll turn ambiguous ideas into working software : d...Show moreLast updated: 6 days ago
    • Promoted
    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Radiant Systems IncGulbarga, IN
    As part of the Digital Core Transformation team, you will play a key role in designing and implementing Coupa and associated SAP S4HANA capabilities to support Procurement business processes.We are...Show moreLast updated: 1 day ago
    • Promoted
    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Capgemini EngineeringGulbarga, IN
    Having experience on WERUM PAS-X Installation qualifications and version upgradation in the server client architecture.Expert in PAS-X system administration and configuration, ideally based on vers...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    CapgeminiGulbarga, IN
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansGulbarga, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 9 days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    FullFunnelGulbarga, IN
    At FullFunnel, we don’t believe growth should rely on manual grind—we believe in.That’s why we’re looking for a.This is not your average ops role. If you geek out on solving complex system puzzles a...Show moreLast updated: 30+ days ago
    • Promoted
    Purchasing Engineer

    Purchasing Engineer

    STL - Sterlite Technologies LimitedGulbarga, IN
    Material Planning & Procurement.Forecast and formulate raw material requirements; schedule material and communicate delivery plans to suppliers. Create Purchase Orders & Schedule Agreements for raw ...Show moreLast updated: 1 day ago