Talent.com
This job offer is not available in your country.
DigiHelic Solutions - Kafka Developer - Big Data Tools

DigiHelic Solutions - Kafka Developer - Big Data Tools

Digihelic Solutions Private LimitedIndia
30+ days ago
Job description

Job description :

Job Title : Kafka Developer

Location : Bangalore / Hyderabad (Hybrid Work Model)

Experience : 5 to 10 years

Shift Timings : 2 : 00 PM to 11 : 00 PM

About the Role :

We are looking for an experienced Kafka Developer to join our team and play a key role in designing, developing, and maintaining scalable big data solutions.

The ideal candidate will have strong expertise in Apache Kafka along with a solid background in Hadoop and HDFS.

This role requires hands-on experience with the big data ecosystem and data engineering best practices to support our data-driven initiatives.

Key Responsibilities :

  • Design, develop, and maintain Kafka-based streaming data pipelines and real-time data processing solutions.
  • Work with large datasets using Hadoop ecosystem tools and technologies.
  • Implement and manage data ingestion, processing, and storage on HDFS.
  • Collaborate with data engineers, architects, and analysts to deliver reliable, scalable, and high-performance data solutions.
  • Optimize Kafka clusters and pipelines for performance, scalability, and fault tolerance.
  • Troubleshoot and resolve issues related to Kafka, Hadoop, and related big data components.
  • Participate in code reviews, testing, and documentation to ensure high-quality deliverables.
  • Stay updated with the latest trends and advancements in big data technologies and propose improvements.

Mandatory Skills :

  • Strong experience with Apache Kafka, including Kafka Streams, Kafka Connect, and cluster management.
  • Hands-on experience with Big Data technologies, particularly Hadoop and HDFS.
  • Proficient in developing data pipelines and streaming data architectures.
  • Solid understanding of distributed systems and data engineering concepts.
  • Experience with data ingestion tools and ETL processes.
  • Ability to work in a hybrid environment and flexible with shift timings (2 PM to 11 PM).
  • Good to Have :

  • Prior experience in data engineering roles.
  • Knowledge of Spark, Flink, or other real-time data processing frameworks.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and related big data services.
  • Experience with scripting languages such as Python, Shell, or Java.
  • Qualifications :

  • Bachelors or Masters degree in Computer Science, Information Technology, or related field.
  • Skills :

  • Kafka,Big Data,Hadoop,Python
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Developer • India

    Related jobs
    • Promoted
    Big Data Developer(Chennai)

    Big Data Developer(Chennai)

    Tata Consultancy ServicesIndia
    Greetings from Tata Consultancy Services!!!.TCS has been a great pioneer in feeding the fire of young techies like you.We are a global leader in the technology arena and there’s nothing that can st...Show moreLast updated: 20 days ago
    • Promoted
    Databricks lead

    Databricks lead

    RecroIndia
    Designation - Databricks lead Experience - 8+ Years.Key Responsibilities • Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks. Architect and optimize big da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Big Data

    Data Engineer - Big Data

    FirstcareercentreIndia
    Job Summary : We are looking for a skilled Big Data Engineer with expertise in Google BigQuery to join our team.The idea...Show moreLast updated: 2 days ago
    • Promoted
    Big Data Analyst - Kafka / Hadoop

    Big Data Analyst - Kafka / Hadoop

    SKS EnterprisesIndia
    About the Role : We are seeking a highly skilled Big Data Analyst to join our data-driven team.The ideal candidate will be responsible for analyzin...Show moreLast updated: 10 days ago
    • Promoted
    Big Data Cloud Architect

    Big Data Cloud Architect

    RecruinIndia
    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on experti...Show moreLast updated: 26 days ago
    • Promoted
    DigiHelic Solutions - Big Data Developer - ETL / PySpark

    DigiHelic Solutions - Big Data Developer - ETL / PySpark

    Digihelic Solutions Private LimitedIndia
    Job description Key Responsibilities : - Big Data Architecture : Design, develop, and maintain scalable and d...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    USTIndia
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show moreLast updated: 4 days ago
    • Promoted
    Matillion

    Matillion

    Tata Consultancy ServicesIndia
    Greetings from Tata Consultancy Services!!.Position : Matillion Job Location : Kochi Experience : 6-10 years.Interested professionals kindly apply through the link. Design and develop ETL / ELT processe...Show moreLast updated: 7 days ago
    • Promoted
    Kafka Developer - Data Streaming Platforms

    Kafka Developer - Data Streaming Platforms

    People Prime World WideIndia
    Key Responsibilities : - Design, develop, and maintain scalable and reliable Apache Kafka-based data streaming platforms.Utilize Kafka Conn...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    ImpetusIndia
    Experience in working on Spark framework, good understanding of core concepts, optimizations, and best practices Good hands-on experience in writing code in PySpark, should understand design princi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Dataiku Developer

    Senior Dataiku Developer

    SPNX ConsultingIndia
    Job Description : - Supports Analytics solutions team in ramping up F&A analytics and reporting practice using Dataiku platformShow moreLast updated: 30+ days ago
    • Promoted
    Axim Digitech - Mavenlink Developer - Kantata Professional Services Cloud

    Axim Digitech - Mavenlink Developer - Kantata Professional Services Cloud

    Axim DigitechIndia
    We are seeking a skilled Kantata Professional Services Cloud Developer with hands-on experience in Mavenlink (Kantata OX) to support, customize, and enhance our professional services automation pla...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Iris Software Inc.India
    Iris is a professional software services organization offering high-quality, cost-effective solutions to businesses.It has helped meet the IT requirements of companies ranging from those among the ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    Tata Consultancy ServicesIndia
    JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting Should be comfortable with Unix File system as well as HDFS commands Should have worked on query languages such as Oracle SQ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer

    Big Data Developer

    HireologistIndia
    About the Role We are looking for a.You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and q...Show moreLast updated: 4 days ago
    • Promoted
    Big Data Specialist

    Big Data Specialist

    Brillionagpur, maharashtra, in
    We are seeking a highly skilled Big Data Engineer to join our team.The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distribute...Show moreLast updated: 26 days ago
    • Promoted
    Hadoop Administrator - Big Data

    Hadoop Administrator - Big Data

    Tehno RightIndia
    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFO Job description : What is your Role ? - You will mana...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Big Data Developer (Hyderabad, Pune, Chennai, Bangalore, Noida)

    Tata Consultancy ServicesIndia
    Bigdata Developer Relevant Experience (in Yrs) : .Hyderabad, Pune, Chennai, Bangalore, Noida.Technical / Functional Skills Must Have Experience in : . Hands on experience in Spark, Scala and Pyspark 2.Sh...Show moreLast updated: 18 days ago