Software Developer - AWS & Kafka - Data Pipeline

Responsibilities :

• Develop, and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services.
• Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems.
• Demonstrate a strong understanding of the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry.
• Design and implement scalable ETL / ELT workflows to process large volumes of data efficiently.
• Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue.
• Implement robust monitoring, testing, and observability practices to ensure data platform reliability and performance.
• Uphold data security, governance, and compliance standards across all data operations.

Requirements :

(ref : hirist.tech)