Kafka Architect (Kafka Event Hub Stream)
Job Description :
The Kafka Architect will be a senior architect / engineer responsible for designing, implementing, and advising on large-scale Confluent Kafka platforms. This role involves guiding the overall direction of the Kafka platform, ensuring alignment with business objectives and collaborating with various technology stakeholders.
Roles and Responsibilities :
- Lead the design and architecture of large-scale Confluent Kafka platforms.
- Develop and maintain architectural artifacts for Kafka solutions.
- Ensure Kafka platform meets requirements for performance, scalability, reliability, and security.
- Provide expert guidance on Kafka best practices, including topic design, partitioning, replication, and security.
- Collaborate with development teams, other architects, and operations.
- Partner with technology decision-makers to guide the overall direction of the platform.
- Identify and implement optimizations for Kafka clusters.
Years of Experience : 7-10+ years
Primary Skillset :
Confluent Kafka, Apache Kafka, Kafka Streams, KSQL, ZooKeeper, Event-driven architecture.Secondary Skillset :
Java / Scala development, Kubernetes / Cloud deployment for Kafka, Monitoring tools (e.g., Prometheus, Grafana).Must-have Skills :
Proven experience in designing and implementing large-scale Confluent Kafka platforms.Deep understanding of Kafka architecture, core concepts, and ecosystem components (Connect, Streams, Schema Registry).Experience with Kafka security (authentication, authorization, encryption).Hands-on experience with Kafka cluster administration, monitoring, and troubleshooting.Good-to-have Skills :
Confluent Certified Developer / Administrator for Apache Kafka.Experience with deploying Kafka on Kubernetes.Knowledge of other streaming technologies.