Talent.com
This job offer is not available in your country.
Real-Time Data Pipeline Engineer

Real-Time Data Pipeline Engineer

ValueLabsIndia
5 days ago
Job description

Dear Aspirants,

Greetings from Valuelabs ! Hope you all are doing safe and well !!

Hiring RTS - Real Time Streaming || ValueLabs || Bangalore || BCIT Experience : 5+ Years Timings : Regular Shift Location :

ValueLabs || Bangalore || BCIT

JD Experience Minimum 5+ years of development and design experience in Java / Scala / Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data) and Kafka. Technical Skills

  • Containerization and orchestration (Docker and OpenShift / Kubernetes)
  • Kafka, Flink, Beam / Kafka streams, Apache Spark or similar streaming technologies
  • Source control (GIT), automated build / deployment pipelines (Jenkins, ArgoCD, Kaniko, Shipwright etc.)
  • Public Cloud preferably Azure and OCI
  • Linux OS configuration and using shell scripting
  • Working with streaming data sets at scale
  • Public Cloud automation toolset
  • Cloud Native applications
  • Understanding of GitOps
  • Extensive coding experience and knowledge in event driven and streaming architecture
  • Good hands-on experience with design patterns and their implementation
  • Experience doing automated unit and integration testing
  • Well versed with CI / CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem
  • Familiar with Distributed services resiliency and monitoring in a production environment.
  • Responsible for adhering to established policies, following best practices, developing, and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.
  • High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures
  • Understand data sensitivity in terms of logging, events and in memory data storage– such as no card numbers or personally identifiable data in logs.
  • Distributed systems
  • Network fundamentals and host-level routing
  • Tuning distributed systems
  • Automated testing
  • Security engineering practices and tools.
  • Event driven architecture Functional Skills
  • Experience in Agile methodology.
  • Ensure quality of technical and application architecture and design of systems across the organization.
  • Analytical thinking
  • Effectively research and benchmark technology against other best in class technologies.
  • Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience.
  • Self-motivator and self-starter, ability to own and drive things without supervision and works collaboratively with the teams across the organization. Soft Skills Have excellent soft skills and interpersonal skills to interact team members. Strategic Thinking with Research and Development mindset Excellent communication skills (verbal, written, and presentation) Check Points :

Interested candidates can apply with the below details for this email renureddy.dyapa@valuelabs.com Total Exp :

Relevant Exp :

Current CTC :

Expected CTC :

Notice period / If Serving please mention LWD :

Current location :

Ready to Relocate to Bangalore from day 1 :

Any Offers in pipeline / Offer Value :

Do you have PF deductions in your current company :

Do you have Form 16 :

  • Note : Please share this job so that someone who is seeking might help them
  • References are highly appreciated !! Reach out to me over linkedin :
  • Best regards, Dyapa Renu Reddy Lead HR - TAG

    Create a job alert for this search

    Data Pipeline Engineer • India

    Related jobs
    • Promoted
    Lead Data Engineer - Data Pipeline

    Lead Data Engineer - Data Pipeline

    HION SECURITY PRIVATE LIMITEDHyderabad
    About the Lead Data Engineer Role As a Data Engineer with ETL / ELT background, the candidate needs to design and develop reusable data ingestion processes from variety...Show moreLast updated: 10 days ago
    • Promoted
    UsefulBI Corporation - Data Engineer - Data Pipeline

    UsefulBI Corporation - Data Engineer - Data Pipeline

    USEFULBI CORPORATIONBangalore
    Job Description : UsefulBI is looking for highly skilled candidates with expertise in generating powerful business insights from very large...Show moreLast updated: 9 days ago
    • Promoted
    Lead Pipeline Engineer

    Lead Pipeline Engineer

    LamprellChennai, Tamil Nadu, India
    Subsea Pipeline Engineer with 10+ years of experience in EPC Offshore industry.CRPO / Aramco project experience preferred.Show moreLast updated: 1 day ago
    • Promoted
    Zensar Technologies - Data Engineer - ETL / Data Pipeline

    Zensar Technologies - Data Engineer - ETL / Data Pipeline

    Zensar TechnologiesBangalore
    Responsibilities : - Design, develop, and maintain scalable and reliable data pipelines to support data extraction, tran...Show moreLast updated: 30+ days ago
    AWS Data Pipeline Engineer

    AWS Data Pipeline Engineer

    5100 Kyndryl Solutions Private LimitedINMANBP Bangalore Manyatha
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ...Show moreLast updated: 17 days ago
    2913-Staff Engineer (Real Time Data Processing)

    2913-Staff Engineer (Real Time Data Processing)

    Innovaccer AnalyticsNoida, UP, IN
    Quick Apply
    Hello! You've landed on this page, which means you're interested in working with us.Let's take a sneak peek at what it's like to work at Innovaccer. With every line of code, we accelerate our c...Show moreLast updated: 20 days ago
    Pipeline Stress Engineer

    Pipeline Stress Engineer

    MCE Consulting EngineersMumbai Suburban, Maharashtra, India
    Perform stress analysis of onshore and offshore pipelines using CAESAR II or equivalent software.Ensure pipeline systems comply with international codes such as ASME B31. Evaluate thermal expansion ...Show moreLast updated: 16 days ago
    • Promoted
    Azure Data Engineer - Data Pipeline

    Azure Data Engineer - Data Pipeline

    Intellikart Ventures LLPMumbai
    Job Overview : We are looking for a skilled Azure Data Engineer with strong experience in data modeling, pipeline development, and SQL / Spark exper...Show moreLast updated: 19 days ago
    • Promoted
    Data Pipeline Engineer - ETL / OLAP - Healthcare Domain

    Data Pipeline Engineer - ETL / OLAP - Healthcare Domain

    smart Data EnterprisesDelhi, IN
    Remote
    Job Title : Freelance Data Pipeline Engineer ETL, OLAP, Healthcare (HL7, FHIR) Employment Type : Full-Time Freelancer (Independent Contractor) &...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer - ETL Pipeline

    Data Engineer - ETL Pipeline

    Grizmo LabsHyderabad
    Key Responsibilities : - Design, Develop, and Maintain real-time / streaming ETL pipelines.Manage and optimize data workflows & pipelines using tools such as Pent...Show moreLast updated: 27 days ago
    • Promoted
    Data Pipeline Engineer - ETL / Matillion

    Data Pipeline Engineer - ETL / Matillion

    SUPERSOURCING TECHNOLOGIES PRIVATE LIMITEDPune
    Job Title : Data Pipeline Engineer Matillion, Snowflake, SQL Location : Pune / Hyderabad / Bangalore Department : Da...Show moreLast updated: 30+ days ago
    Senior Data Engineer - Real Time Streaming

    Senior Data Engineer - Real Time Streaming

    ValueLabsBengaluru, Karnataka, India
    Days Work from Office Role (Bangalore - BCIT).Minimum 5+ years of development and design experience in Java / Scala / Python with Flink, Beam (or Spark Streaming using Real Time data and not batch data...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer - Data Pipeline

    Senior Data Engineer - Data Pipeline

    ContactXIndia
    Role Title : Senior Data Engineer / Big Data Developer Role Summary : As a Seni...Show moreLast updated: 12 days ago
    • Promoted
    C# Data Engineer - ETL / Data Pipeline

    C# Data Engineer - ETL / Data Pipeline

    NPG ConsultantsBangalore
    Were seeking a talented and driven Data Engineer with a strong foundation in C# development to join our growing data engineering team. Youll play a key role in designing and maintaining sc...Show moreLast updated: 7 days ago
    • Promoted
    Senior Databricks Engineer - Data Pipeline

    Senior Databricks Engineer - Data Pipeline

    Growel Softech Pvt. Ltd.Pune
    Senior Databricks Engineer Description : We are seeking a Senior Databricks Engineer to join our dynamic team in India.The ide...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer - ETL Pipeline

    Senior Data Engineer - ETL Pipeline

    SMARTWORK IT SERVICESGurgaon
    Key Responsibilities : - Consult with business and technology stakeholders to understand data requirements, troubleshoot and advise on best-fit AWS d...Show moreLast updated: 21 days ago
    • Promoted
    CBTS - Data Engineer - ETL Pipeline

    CBTS - Data Engineer - ETL Pipeline

    CBTS TECHNOLOGY SOLUTIONS INDIA LLTDChennai
    About the Role : We are seeking a skilled and experienced Data Engineer to join our team in Chennai.This role is ideal for someone who is highly prof...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL / Data Pipeline

    Data Engineer - ETL / Data Pipeline

    Anlage Infotech (India) Pvt LtdMumbai
    Job Description : Location : Mumbai Experience : 5 to 10 years Role and Respo...Show moreLast updated: 23 days ago
    Engineer Pipeline CBM

    Engineer Pipeline CBM

    Reliance Industries LimitedIndia
    Interested candidates, kindly mail to.Main Purpose : To ensure the integrity, safety and seamless operation of the gas and water pipeline network in the RIL CBM Shahdol block by applying proactive m...Show moreLast updated: 28 days ago
    pipeline checker engineer

    pipeline checker engineer

    NaukripayGurgaon, Haryana, India
    They review drawings specifications and other materials to identify errors ensure adherence to codes and standards and provide feedback to designers. This role is crucial for preventing issues durin...Show moreLast updated: 30+ days ago