This job offer is not available in your country.

Senior Data Engineer

ConfidentialChennai, Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana

30+ days ago

Job description

Data Engineer : 8+year experience in design and development of streaming data pipelines.

Experience to deal with large stream volumes.

Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies

Desirable experience in Databricks, Snowflake or any data warehouse technologies.

Experience using AWS native services.

Recent project worked on that involved real-time data required

Knowledge about data quality and integrity in real-time data processing

Knowledge of how to handle duplicate data in a database

Knowledge about stream processing frameworks like Apache Kafka and Apache Flink

Managing handle schema evolution in a data pipeline

Handling missing data during transformation

Education

Bachelor of Business Administration (B.B.A)

Skills Required

Kafka, Aws, Apache Flink

Senior Data Engineer • Chennai, Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana