Talent.com
No longer accepting applications
Kafka Engineer

Kafka Engineer

EXLThoothukudi, IN
2 days ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Thoothukudi, IN

    Related jobs
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Financethoothukudi, tamil nadu, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show moreLast updated: 17 days ago
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    TorinitThoothukudi, IN
    Canadian-based digital consulting company.At Torinit, we don't just serve our clients; we work with them to create transformative digital journeys by leveraging the latest technologies and world-cl...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasThoothukudi, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DonyatiThoothukudi, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 4 days ago
    • Promoted
    Cloud Spend Optimization Engineer

    Cloud Spend Optimization Engineer

    Abacus.AIThoothukudi, IN
    We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Thoothukudi, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    VDEXThoothukudi, IN
    VDEX is a rapidly-growing perpetual exchange powered by zero knowledge state channels.The exchange recently surpassed $2 billion in volume and is incubated by Binance Labs.Responsibilities and Requ...Show moreLast updated: 4 days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    FullFunnelThoothukudi, IN
    At FullFunnel, we don’t believe growth should rely on manual grind—we believe in.That’s why we’re looking for a.This is not your average ops role. If you geek out on solving complex system puzzles a...Show moreLast updated: 30+ days ago
    • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR SolutionsThoothukudi, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show moreLast updated: 18 days ago
    • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdgeThoothukudi, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show moreLast updated: 18 days ago
    • Promoted
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgeminitirunelveli, tamil nadu, in
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 2 days ago
    • Promoted
    Lead Coupa Architect – Source to Pay

    Lead Coupa Architect – Source to Pay

    Maitsystirunelveli, tamil nadu, in
    As part of the Digital Core Transformation team, you will design and implement Coupa and SAP S / 4HANA capabilities supporting global Procurement processes. The role requires experience in solution de...Show moreLast updated: 3 days ago
    • Promoted
    GTM Engineer

    GTM Engineer

    ScalantecThoothukudi, IN
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 4 days ago
    • Promoted
    Cloud Cost Optimization Engineer

    Cloud Cost Optimization Engineer

    techjaysThoothukudi, IN
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeansThoothukudi, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 11 days ago
    • Promoted
    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    FICOthoothukudi, tamil nadu, in
    FICO is seeking a Full-Stack observability Lead Engineer to design, maintain, and optimize our observability platform.The ideal candidate will be an expert in Open telemetry(Otel) instrumentation a...Show moreLast updated: 16 days ago
    • Promoted
    Senior RTL Design Engineer

    Senior RTL Design Engineer

    MosChip®Thoothukudi, IN
    Experience in Logic design / RTL coding is a must.Experience is SoC design and integration for complex SoCs is a must.Experience in Verilog / System-Verilog is a must. Experience in Multi Clock design...Show moreLast updated: 3 days ago
    • Promoted
    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Werum PAS-X Engineer EXP : 2 to 6 years - Location Pune / Mumbai

    Capgemini EngineeringThoothukudi, IN
    Having experience on WERUM PAS-X Installation qualifications and version upgradation in the server client architecture.Expert in PAS-X system administration and configuration, ideally based on vers...Show moreLast updated: 30+ days ago