Kafka Administrator

Responsibilities

• Deploy and upgrade production-grade Kafka clusters, ensuring high availability and fault tolerance.
• Automate the installation and configuration of Kafka clusters using tools such as Ansible and Chef.
• Troubleshoot critical production issues, optimizing Kafka performance and minimizing downtime.
• Configure MirrorMaker for data replication between two data centers, ensuring effective disaster recovery.
• Deploy and manage Provectus Kafka UI on a Kubernetes cluster for real-time monitoring and management.
• Integrate Schema Registry and deploy multiple Kafka Connectors to facilitate seamless data flow.
• Onboard new users by managing ACL permissions, creating topics, and implementing end-to-end security with SSL / TLS.
• Design and manage Kafka infrastructure to enhance message processing efficiency.
• Conduct performance testing to optimize partitioning, replication, and retention policies.
• Integrate Kafka with ELK Stack and Solr for scalable data storage and analysis.

Qualifications

BE, BTech, MCA and MCS only.

Required Skills

Kafka clusters, MirrorMaker, Kafka Streams, Schema Registry, Kubernetes, Docker, Ansible, Terraform, Monitoring & Logging, Programming & Scripting, Shell Scripting.

Experience

3+ years of experience

Location

Bangalore

Show more

Show less

Skills Required

Scripting, Shell Scripting, Programming, Docker, Terraform, Ansible, Kubernetes, Logging, Monitoring