Kakfa Engineer - CI / CD Pipeline

Job Title : Kafka Engineer

Experience : 5 to 7 years

Job Summary :

We are seeking a skilled Kafka Engineer to design, build, and maintain real-time streaming pipelines using Apache Kafka. The role involves developing Java-based producers / consumers, ensuring scalability, fault tolerance, and schema governance, and integrating Kafka into CI / CD pipelines. Youll collaborate with DevOps teams to manage infrastructure, security, and automation while enabling enterprise-wide real-time data processing.

Key Responsibilities :

• Design and maintain high-throughput, low-latency Kafka streaming pipelines.
• Develop robust Kafka producers and consumers in Java.
• Implement schema governance using Confluent Schema Registry (Avro / Protobuf).
• Collaborate with DevOps for CI / CD, deployment, and infrastructure management.
• Ensure security best practices for Kafka clusters (encryption, authentication, access control).
• Monitor and troubleshoot Kafka performance, latency, and message delivery.
• Document architecture, deployment, and operational processes.
• Participate in code reviews and knowledge-sharing sessions.

Must-Have Skills :

Good-to-Have Skills :

(ref : hirist.tech)