Real-Time Data Pipeline Engineer

Dear Aspirants,

Greetings from Valuelabs ! Hope you all are doing safe and well !!

Hiring RTS - Real Time Streaming || ValueLabs || Bangalore || BCIT Experience : 5+ Years Timings : Regular Shift Location :

ValueLabs || Bangalore || BCIT

JD Experience Minimum 5+ years of development and design experience in Java / Scala / Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills

• Containerization and orchestration (Docker and OpenShift / Kubernetes)
• Kafka, Flink, Beam / Kafka streams, Apache Spark or similar streaming technologies
• Source control (GIT), automated build / deployment pipelines (Jenkins, ArgoCD, Kaniko, Shipwright etc.)
• Public Cloud preferably Azure and OCI
• Linux OS configuration and using shell scripting
• Working with streaming data sets at scale
• Public Cloud automation toolset
• Cloud Native applications
• Understanding of GitOps
• Extensive coding experience and knowledge in event driven and streaming architecture
• Good hands-on experience with design patterns and their implementation
• Experience doing automated unit and integration testing
• Well versed with CI / CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem
• Familiar with Distributed services resiliency and monitoring in a production environment.
• Responsible for adhering to established policies, following best practices, developing, and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.
• High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures
• Understand data sensitivity in terms of logging, events and in memory data storage– such as no card numbers or personally identifiable data in logs.
• Distributed systems
• Network fundamentals and host-level routing
• Tuning distributed systems
• Automated testing
• Security engineering practices and tools.
• Event driven architecture Functional Skills
• Experience in Agile methodology.
• Ensure quality of technical and application architecture and design of systems across the organization.
• Analytical thinking
• Effectively research and benchmark technology against other best in class technologies.
• Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience.
• Self-motivator and self-starter, ability to own and drive things without supervision and works collaboratively with the teams across the organization. Soft Skills Have excellent soft skills and interpersonal skills to interact team members. Strategic Thinking with Research and Development mindset Excellent communication skills (verbal, written, and presentation) Check Points :

Interested candidates can apply with the below details for this email renureddy.dyapa@valuelabs.com Total Exp :

Relevant Exp :

Current CTC :

Expected CTC :

Notice period / If Serving please mention LWD :

Current location :

Ready to Relocate to Bangalore from day 1 :

Any Offers in pipeline / Offer Value :

Do you have PF deductions in your current company :

Do you have Form 16 :

Best regards, Dyapa Renu Reddy Lead HR - TAG