Job Description :
- We are seeking a skilled Kafka Integration Engineer with hands on experience in Confluent Kafka to join our data engineering team
- The ideal candidate will be responsible for designing developing and maintaining scalable real time data pipelines and integrations using Kafka and Confluent components
Key Responsibilities :
Design and implement real time streaming solutions using Kafka Confluent Platform and Confluent CloudDevelop stream processing applications using Apache Flink ksqlDB and Kafka StreamsBuild data governance frameworks using Confluent s Stream Governance suiteImplement data lineage tracking and stream catalog managementDeploy and manage KRaft based clusters ZooKeeper free Kafka architectureConfigure client side field level encryption for sensitive data protectionIntegrate Kafka with enterprise systems databases APIs microservicesManage Kafka clusters topics schemas and connectorsOptimize performance scalability and reliability of Kafka solutionsConfigure and manage KRaft controllers and metadata managementImplement disaster recovery and cross region replication strategiesSet up monitoring using next generation Confluent Control Center with Prometheus OpenTelemetryDeploy and manage Confluent for Kubernetes CFK and Ansible automationMonitor and troubleshoot Kafka pipelines and infrastructureEnsure data governance security and compliance in streaming workflowsCollaborate with data engineers architects and DevOps teamsTechnical Requirements :
5 years experience with Confluent Kafka and Apache KafkaProgramming Strong proficiency in Java Python or ScalaKafka Ecosystem Kafka Connect Kafka Streams KSQL Schema Registry REST Proxy Confluent Control CenterConfluent Platform Stream Governance Data Lineage Stream Catalog Audit Logs Role Based Access Control RBACConfluent Cloud Fully managed Kafka service ksqlDB Cloud Apache Flink on Confluent CloudStream Processing Apache Flink ksqlDB real time analytics and complex event processingArchitecture Event driven architecture and data streaming patternsDevOps Docker Kubernetes CI CD pipelinesCloud AWS GCP or Azure with Kafka deployment experienceSoft Skills Excellent problem solving and communication abilitiesPreferred Skills : Technology->
Java->
Apache->
Kafka
Skills Required
Data Lineage, Apache Flink, Java, Aws, Python, Kubernetes, Azure, Docker, Gcp, Apache Kafka, Scala