Description : Responsibilities :
- Design, build, and manage Kafka clusters using the Confluent Platform for enterprise-grade data streaming solutions.
- Implement Kafka Connect, Kafka Streams, and ksqlDB to develop and manage real-time data pipelines and stream processing applications.
- Monitor, maintain, and optimize Kafka cluster performance, ensuring high availability, fault tolerance, and scalability.
- Develop and maintain Terraform and Ansible scripts to automate Kafka platform setup, configuration, and deployment.
- Implement and manage Kafka security features, including RBAC, ACLs, SSL, and SASL for secure data communication and controlled access.
- Perform capacity planning, troubleshooting, and root cause analysis for Kafka-related issues.
- Collaborate with DevOps, Data Engineering, and Application teams to integrate Kafka with enterprise systems.
- Maintain documentation and best practices for Kafka administration, scaling, and performance tuning.
Requirements :
Experience : 5+ Years.Strong hands-on experience as a Kafka Administrator with Kafka platform setup and cluster management.Experience with Confluent Kafka ecosystem (Kafka Connect, Streams, ksqlDB).Proficiency in Terraform and / or Ansible for infrastructure automation.Good understanding of Kafka security protocols - RBAC, ACLs, SSL, SASL.Expertise in monitoring tools such as Confluent Control Center, Grafana, or Prometheus.Preferred Qualifications :
Experience with AWS, Azure, or GCP Kafka deployments.Knowledge of CI / CD pipelines and container orchestration tools like Docker or Kubernetes.Familiarity with Linux system administration and scripting (Bash / Python).Confluent Certified Administrator or Developer certification is a plus.(ref : hirist.tech)