Role :
Required Technical Skill Set :
- Sound knowledge of Apache Kafka Configuration and Pub / Sub Integration, Java, Microservices
Desired Competencies (Technical / Behavioral Competency)
Must-Have :
Developing scripts / code for Kafka ConnectorDeveloping scripts / code for KstreamDeveloping Publisher and Subscriber for Kafka TopicsConfigure Kafka topics with Different consumer groups and PartitionsSetting up Kafka cluster and security for Kafka clusterDevelop Java Code, Spring / Spring Boot microservices, SQL and UNIX scriptsGood-to-Have :
Experience in Agile development environmentExperience in BFSI Domain, specifically corporate :Engage with the customer to understand the requirements, provide technical solutions, provide value added suggestionsHelp build and manage the team of Kafka and Java developers in the near future.Key Skills / Knowledge :
Engineer having competencies like Apache Beam, GCP Cloud, Open ShiftShould have experience in Java and Kafka Streaming. GCP and Kubernetes knowledge nice to have.Develop and Deploy data and analytics-led solutions on GCPExperience designing highly available and scalable systemsHands-on of Data Engineering solutions using Cloud BigQuery, Cloud DataFlow, Cloud BigTable, Storage, Cloud Spanner, Cloud IAMUnderstanding of Apache KafkaProficiency in cloud based ETL / Data Orchestration tools like Apache Beam, Cloud composerExperience in Stack driver logging / monitoringExperience in Python is a MUSTHands-on experience with Apache spark and its components(Streaming) is a strong advantageExperience with automation tools such as Ansible, TerraformFamiliar with containers like Kubernetes, Docker, HelmAbility to effectively communicate complex technical concepts to a broad range of audiences(ref : hirist.tech)