Kafka Developer - Data Streaming Platforms

Key Responsibilities :

• Design, develop, and maintain scalable and reliable Apache Kafka-based data streaming platforms.
• Utilize Kafka Connect, Kafka Streams, and Kafka client libraries to build real-time data pipelines and event-driven applications.
• Independently resolve issues related to infrastructure deployment and application setup on cloud services (Azure preferred).
• Manage containerized environments using Kubernetes, OpenShift, and Docker for deployment and orchestration.
• Implement secure and scalable cloud architectures on Azure, including Azure Functions, Logic Apps, App Service, Azure Kubernetes Service, Databricks, Event Hubs, Service Bus, Event Grid, and Data Lake Storage.
• Apply in-depth knowledge of private networking concepts, including VNets / VPCs, private endpoints, firewalls, and DNS configurations.
• Develop software using popular programming languages such as Java, C#, JavaScript, or Python, with strong expertise in at least one language.
• Employ Infrastructure-as-Code (IaC) tools such as Terraform, Helm, and scripting languages like Bash to automate deployments.
• Work with CI / CD frameworks like GitHub Actions or Azure Pipelines to streamline build and deployment processes.
• Debug applications effectively, implement logging, monitoring, and observability solutions to ensure system health and performance.
• Utilize developer portals and API management tools (e.g., Backstage, Azure API Management, IBM API Connect) to manage APIs and event-driven architectures.
• Build event-driven microservices and RESTful APIs following best practices and design Skills :
• 10+ years of experience with Apache Kafka and related technologies (Kafka Connect, Kafka Streams, schema registries).
• Strong understanding of Kubernetes, Docker, and container orchestration.
• Proven experience with Azure cloud services and architecture.
• Deep knowledge of enterprise private networking and security topologies.
• Proficiency in software design patterns and at least one programming language (Java, C#, JavaScript, Python).
• Experience with Infrastructure-as-Code and CI / CD tools.
• Familiarity with API gateways, developer portals, and event-driven microservices architecture.
• Strong problem-solving skills and ability to independently resolve complex technical :
• Bachelors degree in Computer Science, Engineering, or related field (or equivalent experience).

(ref : hirist.tech)