Kafka Engineer - Monitoring Tools

We are looking for a skilled Kafka Engineer with 57 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The Kafka Engineer will have strong expertise in Java-based development, Kafka architecture, and CI / CD integration. Youll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

• Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
• Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro / Protobuf).
• Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards.
• Collaborate with DevOps teams to automate CI / CD pipelines, deployment, and infrastructure provisioning for Kafka components.
• Implement security best practices including encryption, authentication, and access control for Kafka clusters.
• Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery

guarantees.

Must-Have Skills :

automation.

Good-to-Have Skills :

(ref : hirist.tech)