Talent.com
Kafka Engineer
Kafka EngineerEXL • ludhiana, punjab, in
No longer accepting applications
Kafka Engineer

Kafka Engineer

EXL • ludhiana, punjab, in
3 days ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • ludhiana, punjab, in

    Related jobs
    Lead Coupa Architect – Source to Pay

    Lead Coupa Architect – Source to Pay

    Maitsys • ludhiana, punjab, in
    As part of the Digital Core Transformation team, you will design and implement Coupa and SAP S / 4HANA capabilities supporting global Procurement processes. The role requires experience in solution de...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • ludhiana, punjab, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 19 days ago • Promoted
    Android Engineer

    Android Engineer

    People Prime Worldwide • ludhiana, punjab, in
    Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show more
    Last updated: 10 hours ago • Promoted • New!
    AWS Engineer

    AWS Engineer

    Spryc Systems • ludhiana, punjab, in
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 19 days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Group • ludhiana, punjab, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
    Last updated: 3 days ago • Promoted
    Senior Developer

    Senior Developer

    Virtusa • ludhiana, punjab, in
    Flexcube Application Developer Extension Development.Job SummaWe are seeking a skilled Flexcube Application Developer with handson experience in developing extensions and customizations for Oracle ...Show more
    Last updated: 4 days ago • Promoted
    Platform Engineer - Experian PowerCurve Collections

    Platform Engineer - Experian PowerCurve Collections

    Luxoft • ludhiana, punjab, in
    The Project is for one of our Banking clients who has Global operations.We're building a team to work on a new Strategic Group platform for our customers' collections business that will provide a m...Show more
    Last updated: 10 hours ago • Promoted • New!
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgemini • ludhiana, punjab, in
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show more
    Last updated: 3 days ago • Promoted
    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    FICO • ludhiana, punjab, in
    FICO is seeking a Full-Stack observability Lead Engineer to design, maintain, and optimize our observability platform.The ideal candidate will be an expert in Open telemetry(Otel) instrumentation a...Show more
    Last updated: 17 days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • ludhiana, punjab, in
    Canadian-based digital consulting company.At Torinit, we don't just serve our clients; we work with them to create transformative digital journeys by leveraging the latest technologies and world-cl...Show more
    Last updated: 2 days ago • Promoted
    Cloud Operations Engineer (DevOps)

    Cloud Operations Engineer (DevOps)

    Suronex • ludhiana, punjab, in
    We’re expanding our team and looking for a skilled.Cloud Operations Engineer (DevOps).If you’re passionate about automation, infrastructure reliability, and modern cloud technologies, we’d love to ...Show more
    Last updated: 1 day ago • Promoted
    Cloud IAM Engineer

    Cloud IAM Engineer

    Vertex Agility • ludhiana, punjab, in
    Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation. Own and deploy IAM across cloud...Show more
    Last updated: 2 days ago • Promoted
    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    ezAIx Inc. • ludhiana, punjab, in
    As part of our expansion, we’re seeking an.Advanced Senior DevOps Engineer.This critical role will drive the scalability of our platform, ensuring robust performance and high availability while emb...Show more
    Last updated: 1 day ago • Promoted
    Coupa Administrator (Contractor)

    Coupa Administrator (Contractor)

    TekWissen India • ludhiana, punjab, in
    Title : Coupa Administrator (Contractor).Job Type : Temporary Assignment.TekWissen Group is a workforce management provider throughout the USA and many other countries in the world.We are seeking a s...Show more
    Last updated: 3 days ago • Promoted
    Senior Workato Engineer

    Senior Workato Engineer

    TalentXM (Formerly BlockTXM Inc) • ludhiana, punjab, in
    The Senior Integration Engineer will design, develop, and implement automations &.This role will collaborate with.The ideal candidate will have a strong understanding of enterprise systems, APIs,.D...Show more
    Last updated: 3 days ago • Promoted
    Senior Enterprise Architect

    Senior Enterprise Architect

    Ironbook AI • ludhiana, punjab, in
    Develop Enterprise loud strategies, lead delivery teams in customer workshop, coordinate with multiple stakeholders in client hierarchy to engage, understand and articulate requirements to create s...Show more
    Last updated: 3 days ago • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavid • ludhiana, punjab, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show more
    Last updated: 4 days ago • Promoted
    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Lead Coupa & SAP S / 4HANA (S2P) Consultant

    Radiant Systems Inc • ludhiana, punjab, in
    As part of the Digital Core Transformation team, you will play a key role in designing and implementing Coupa and associated SAP S4HANA capabilities to support Procurement business processes.We are...Show more
    Last updated: 4 days ago • Promoted