Required Skills & Qualifications :
- Proven experience in developing Kafka producers and consumers for real-time data
ingestion pipelines.
Strong hands-on expertise in Apache Kafka, Kafka Connect, Kafka Streams, andSchema Registry.
Proficiency in Apache Spark (Structured Streaming) for real-time data transformationand enrichment.
Solid understanding of IPFIX, NetFlow, and network flow data formats; experienceintegrating with nProbe Cento is a plus.
Experience with Avro, JSON, or Protobuf for message serialization and schemaevolution.
Familiarity with Cloudera Data Platform components such as HDFS, Hive, YARN, andKnox.
Experience integrating Kafka pipelines with data lakes or warehouses using Parquet orDelta formats.
Strong programming skills in Scala, Java, or Python for stream processing and dataengineering tasks.
Knowledge of Kafka security protocols including TLS / SSL, Kerberos, and access controlvia Apache Ranger.
Experience with monitoring and logging tools such as Prometheus, Grafana, and Splunk.Understanding of CI / CD pipelines, Git-based workflows, and containerization(Docker / Kubernetes)
Skills Required
Git, Apache Kafka, Scala, Java, Python