Kafka Administrator

Key Responsibilities :

- Administer, configure, and maintain Apache Kafka, Confluent Platform (CP), and Confluent Cloud environments.

- Manage Kafka clusters, topics, ACLs, users, brokers, ZooKeeper, Kafka Connect, Replicator, and KSQL.

- Monitor Kafka infrastructure using DataDog, Prometheus, Conduktor, and other monitoring tools.

- Troubleshoot production issues including consumer lag, broker failures, connectivity issues, AVRO schema conflicts, serialization errors, and security-related problems.

- Perform Kafka platform upgrades, patching, certificate renewals, vulnerability remediation, and Disaster Recovery (DR) activities.

- Implement Infrastructure as Code (IaC) using Terraform and support CI/CD automation.

- Collaborate with application teams supporting Java, Spring Boot, .NET, and Python Kafka client applications.

- Administer and maintain Autosys environments, including installation, upgrades, patching, and scheduling support.

- Ensure platform availability, scalability, security, and performance optimization.

- Work closely with DevOps, Development, and Infrastructure teams in an Agile/Scrum environment.

Required Skills & Experience :

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

- 5+ years of hands-on experience in :

a. Apache Kafka Administration

b. Confluent Platform (CP)

c. Confluent Cloud

- Strong expertise in :

a. Kafka Connect

b. Kafka Replicator

c. KSQL

d. ZooKeeper

e. ACL Management

f.Topic Administration

g. User Management

- Experience with :

a. DataDog

b. Prometheus

c. Conduktor

d. Kafka Performance Tuning

e. Consumer Lag Analysis

f. AVRO Schema Registry

g. Serialization & Deserialization

h. Security & Authentication

- Hands-on experience with :

a. Terraform

b. Infrastructure as Code (IaC)

c. DevOps / DevSecOps

d. CI/CD Pipelines

- Experience in :

a. Platform Upgrades

b. Patching

c. Certificate Renewals

d. Vulnerability Remediation

e. Disaster Recovery (DR)

- Experience supporting Kafka client applications developed in :

a. Java

b. Spring Boot

c. .NET

d. Python

- Strong knowledge of Autosys Administration, including installation, maintenance, upgrades, and patching.

- Experience supporting enterprise-scale, production-critical distributed systems.

- Familiarity with Agile/Scrum methodologies and JIRA.

Preferred Skills :

- Kubernetes and Docker

- AWS, Azure, or GCP

- Linux Administration

- Shell Scripting or Python Automation

- Git and Version Control

- Confluent Certifications

(ref:hirist.tech)