Talent.com
Kafka Engineer

Kafka Engineer

EXLDelhi, India
2 days ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro / Protobuf).
  • Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines, deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.
  • Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy.
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Delhi, India

    Related jobs
    • Promoted
    • New!
    TechOps-AMS-Kafka-admin-Senior-E

    TechOps-AMS-Kafka-admin-Senior-E

    EY Studio+ NederlandDelhi, Delhi, India
    At EY youll have the chance to build a career as unique as you are with the global scale support inclusive culture and technology to become the best version of you. And were counting on your unique ...Show moreLast updated: 20 hours ago
    • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    VDEXDelhi, IN
    VDEX is a rapidly-growing perpetual exchange powered by zero knowledge state channels.The exchange recently surpassed $2 billion in volume and is incubated by Binance Labs.Responsibilities and Requ...Show moreLast updated: 4 days ago
    • Promoted
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    CapgeminiMeerut, IN
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 3 days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    FullFunnelDelhi, IN
    At FullFunnel, we don’t believe growth should rely on manual grind—we believe in.That’s why we’re looking for a.This is not your average ops role. If you geek out on solving complex system puzzles a...Show moreLast updated: 30+ days ago
    • Promoted
    Kafka Developer - Java

    Kafka Developer - Java

    Risk Resources LLPDelhi
    Role : Required Technical Skill Set : - Sound knowledge of Apache Kafka Configuration and Pub / Sub ...Show moreLast updated: 30+ days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    ScalantecGhaziabad, IN
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 4 days ago
    • Promoted
    Lead Engineer

    Lead Engineer

    dunnhumbyGurugram, Haryana, India
    Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy.We always put the Customer First. With deep heritage and expertise in retail – one of ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMeerut, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago
    • Promoted
    Kafka

    Kafka

    ConfidentialDelhi, India
    Location : Chennai, Bangalore, Hyderabad, Pune, Delhi, Kolkata.Engineer having competencies like Apache Beam, GCP Cloud, Open Shift. Should have experience in Java and Kafka Streaming.GCP and Kuberne...Show moreLast updated: 22 days ago
    • Promoted
    Lead Engineer- Azure Iaas / Paas

    Lead Engineer- Azure Iaas / Paas

    Acuity Knowledge PartnersGurugram, Haryana, India
    Acuity Knowledge Partners (Acuity) is a leading provider of bespoke research, analytics and technology solutions to the financial services sector, including asset managers, corporate and investment...Show moreLast updated: 1 day ago
    • Promoted
    QA Engineer (Playwright) - Senior II | FINJO I987

    QA Engineer (Playwright) - Senior II | FINJO I987

    Omni Recruit Private LimitedGurugram, Haryana, India
    Quality Assurance Strong programming background with expertise in JavaScript / TypeScript, including core concepts, design patterns, data structures, and debugging Minimum 1-2 years of hands-on exper...Show moreLast updated: 1 day ago
    • Promoted
    Flink Engineer

    Flink Engineer

    CoforgeNoida, Uttar Pradesh, India
    Location : Greater Noida campus.The ideal candidate will design, build, and operate.Design, implement, and optimize.Java-based streaming components. TLS, RBAC / ACLs, schema governance, secrets managem...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer II - Kafka / Spark

    Senior Data Engineer II - Kafka / Spark

    People Connect ConsultantsDelhi, IN
    Remote
    Description : Our client is on the lookout for a Data Engineer - Senior II to architect and maintain high-performance data platforms that fuel decision-making and inn...Show moreLast updated: 18 days ago
    • Promoted
    Senior Kubernetes Network Engineer

    Senior Kubernetes Network Engineer

    World Wide TechnologyDelhi, IN
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 19 days ago
    • Promoted
    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Capgemini EngineeringDelhi, IN
    Having experience on WERUM PAS-X Installation qualifications and version upgradation in the server client architecture.Expert in PAS-X system administration and configuration, ideally based on vers...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Radiant Systems IncMeerut, IN
    As part of the Digital Core Transformation team, you will play a key role in designing and implementing Coupa and associated SAP S4HANA capabilities to support Procurement business processes.We are...Show moreLast updated: 3 days ago
    • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTechDelhi, IN
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansDelhi, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 11 days ago