Talent.com
6767 | Kafka Engineer
6767 | Kafka EngineerEXL • Hubli, Republic Of India, IN
No longer accepting applications
6767 | Kafka Engineer

6767 | Kafka Engineer

EXL • Hubli, Republic Of India, IN
1 day ago
Job description

Job Title : Kafka Engineer (Java)

Experience : 5–8 Years

Job Summary :

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development, Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro / Protobuf).
  • Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines, deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka.
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry, Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation.
  • Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams, ksqlDB, or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy.
  • Experience with monitoring and observability tools (e.G., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • Hubli, Republic Of India, IN

    Related jobs
    Senior DevOps Engineer

    Senior DevOps Engineer

    DevsLane • Hubli-Dharwad, IN
    DevsLane is a leading Software Consultancy Firm based in India.We offer a wide range of services, from proof-of-concepts to end-to-end product development, partnering with clients worldwide to brin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • Hubli-Dharwad, IN
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 8 days ago • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    thinkbridge • Hubli-Dharwad, IN
    We are seeking a highly skilled and experienced Senior DevOps Engineer (Azure) to join our team.In this role, you will be responsible for designing, implementing, and managing our infrastructure an...Show more
    Last updated: 30+ days ago • Promoted
    UI Engineer

    UI Engineer

    BayOne Solutions • Hubli-Dharwad, IN
    Architect, design, and develop scalable and performant full-stack web applications, leading the development of front-end (React / Next. Front-End Development (React / Next.Develop dynamic, responsive, a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cloud IAM Engineer (AWS / Okta)

    Senior Cloud IAM Engineer (AWS / Okta)

    Vertex Agility • Hubli-Dharwad, IN
    Senior Cloud IAM Engineer (AWS / Okta) – Remote.Vertex Agility | Agile On-Demand Solutions.Are you passionate about identity management and cloud security? Vertex Agility is looking for a Senior Cl...Show more
    Last updated: 28 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • Hubli-Dharwad, IN
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 6 days ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    CitNOW Group • Hubli-Dharwad, IN
    Founded in 2008, CitNOW is an innovative, enterprise-level software product suite that allows automotive dealerships globally to sell more vehicles and parts more profitably.CitNOW’s app-based plat...Show more
    Last updated: 30+ days ago • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    Blossom Social • Hubli-Dharwad, IN
    Blossom Social is building the future of social investing.Our platform empowers retail investors by combining the best of social networks with investing tools—enabling users to connect, learn, and ...Show more
    Last updated: 30+ days ago • Promoted
    DevSecOps Engineer

    DevSecOps Engineer

    V2Soft • Hubli-Dharwad, IN
    Required skills and Experience.Plan, research, and design security architectures.Skills in Cloud infrastructure risks and compliance (Preferably AWS). Knowledge in cryptography, public key infrastru...Show more
    Last updated: 18 days ago • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavid • Hubli-Dharwad, IN
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show more
    Last updated: 1 day ago • Promoted
    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    ezAIx Inc. • Hubli-Dharwad, IN
    As part of our expansion, we’re seeking an.Advanced Senior DevOps Engineer.This critical role will drive the scalability of our platform, ensuring robust performance and high availability while emb...Show more
    Last updated: 1 day ago • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTech • Hubli-Dharwad, IN
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show more
    Last updated: 30+ days ago • Promoted
    Application Management & DevOps Engineer

    Application Management & DevOps Engineer

    RapidBrains • Hubli-Dharwad, IN
    Fulltime- Permanent with our German Client (10 K size company).We are looking for an experienced Senior Application Management & DevOps Engineer (B2C Platform)) to take responsibility for the appli...Show more
    Last updated: 1 day ago • Promoted
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgemini • Hubli-Dharwad, IN
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show more
    Last updated: 12 days ago • Promoted
    Senior Azure / Biztalk Developer

    Senior Azure / Biztalk Developer

    Orion Innovation • Hubli-Dharwad, IN
    Job Title : Senior Azure Biztalk Developer.Senior Azure Developer with Biztalk.Design, develop, and support enterprise-level integration solutions. Create technical designs and architectures for comp...Show more
    Last updated: 1 day ago • Promoted
    Cloud Cost Optimization Engineer

    Cloud Cost Optimization Engineer

    techjays • Hubli-Dharwad, IN
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Hubli-Dharwad, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 21 days ago • Promoted
    Solana Blockchain Engineer

    Solana Blockchain Engineer

    GoQuant • Hubli-Dharwad, IN
    SOLANA BLOCKCHAIN ENGINEER (RUST) (Paid).Job Title : Solana Blockchain Engineer - Smart Contracts & Settlement Infrastructure. Company : GoQuant Technologies Inc.Smart Contract Development (60%).Desig...Show more
    Last updated: 30+ days ago • Promoted