Position : Senior Data Engineer (ETL / Big Data / Streaming)
Experience : 810 years
Location : Onsite Hybderabd / Chennai
Mode of Interview : F2F Face to Face Interview
Job Overview :
We are looking for an experienced Senior Data Engineer with strong expertise in ETL / ELT, big data, and real-time data streaming to join our team.
The ideal candidate will have deep hands-on experience with Apache Flink, Confluent Kafka, and related technologies to design and implement large-scale data ingestion, processing, and analytics solutions.
Key Responsibilities :
- Design, develop, and optimize Flink applications for real-time stream processing and analytics.
- Build and manage scalable Confluent Kafka infrastructure, including Brokers, Producers, Consumers, and Schema Registry.
- Implement real-time data transformations using ksqlDB.
- Develop and maintain Kafka Connect connectors, including custom connectors.
- Design and implement large-scale data ingestion, curation, and processing solutions.
- Work with big data technologies on cloud platforms (AWS, Azure, GCP).
- Ensure high performance, scalability, and reliability of streaming pipelines.
- Collaborate with cross-functional teams to deliver data-driven solutions.
- Troubleshoot and optimize data streaming applications and infrastructure.
Required Qualifications :
Bachelors degree or higher from a reputed university.810 years of total experience, with the majority in ETL / ELT, big data, and Kafka.Proficiency in Flink application development for stream processing.Strong understanding of data streaming architectures.Extensive experience with Confluent Kafka ecosystem.Hands-on experience with ksqlDB and Kafka Connect.Solid experience in big data technologies and cloud platforms.Excellent problem-solving, analytical, and communication skills.Ability to work independently and in a team environment.Good to Have :
Experience with Google Cloud Platform (GCP).Exposure to the healthcare industry.Experience working in Agile methodologies.(ref : hirist.tech)