Talent.com
This job offer is not available in your country.
Senior Data Engineer - Big Data / Kafka

Senior Data Engineer - Big Data / Kafka

SMARTWORK IT SERVICESHyderabad
30+ days ago
Job description

Position : Senior Data Engineer (ETL / Big Data / Streaming)

Experience : 810 years

Location : Onsite Hybderabd / Chennai

Mode of Interview : F2F Face to Face Interview

Job Overview :

We are looking for an experienced Senior Data Engineer with strong expertise in ETL / ELT, big data, and real-time data streaming to join our team.

The ideal candidate will have deep hands-on experience with Apache Flink, Confluent Kafka, and related technologies to design and implement large-scale data ingestion, processing, and analytics solutions.

Key Responsibilities :

  • Design, develop, and optimize Flink applications for real-time stream processing and analytics.
  • Build and manage scalable Confluent Kafka infrastructure, including Brokers, Producers, Consumers, and Schema Registry.
  • Implement real-time data transformations using ksqlDB.
  • Develop and maintain Kafka Connect connectors, including custom connectors.
  • Design and implement large-scale data ingestion, curation, and processing solutions.
  • Work with big data technologies on cloud platforms (AWS, Azure, GCP).
  • Ensure high performance, scalability, and reliability of streaming pipelines.
  • Collaborate with cross-functional teams to deliver data-driven solutions.
  • Troubleshoot and optimize data streaming applications and infrastructure.

Required Qualifications :

  • Bachelors degree or higher from a reputed university.
  • 810 years of total experience, with the majority in ETL / ELT, big data, and Kafka.
  • Proficiency in Flink application development for stream processing.
  • Strong understanding of data streaming architectures.
  • Extensive experience with Confluent Kafka ecosystem.
  • Hands-on experience with ksqlDB and Kafka Connect.
  • Solid experience in big data technologies and cloud platforms.
  • Excellent problem-solving, analytical, and communication skills.
  • Ability to work independently and in a team environment.
  • Good to Have :

  • Experience with Google Cloud Platform (GCP).
  • Exposure to the healthcare industry.
  • Experience working in Agile methodologies.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Hyderabad