Talent.com
Kafka Engineer

Kafka Engineer

EXLbaddi, himachal pradesh, in
14 hours ago
Job description

Role - Kafka Engineer

Skills Required : Kafka, Java, SQL

Experience : 5-8 Years

Location : Hyderabad [3 Days a Week]

We are looking for a skilled Kafka Engineer with 5–7 years of experience in designing, building, and maintaining real-time streaming pipelines using Apache Kafka. The ideal candidate will have strong expertise in Java-based development , Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing and ensuring the scalability, fault tolerance, and governance of data streaming across our enterprise systems.

Key Responsibilities :

  • Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing.
  • Ensure scalability , fault tolerance , and schema governance using tools like Schema Registry (Avro / Protobuf) .
  • Develop robust Kafka producers and consumers using Java , adhering to performance and reliability standards.
  • Collaborate with DevOps teams to automate CI / CD pipelines , deployment, and infrastructure provisioning for Kafka components.
  • Implement security best practices including encryption, authentication, and access control for Kafka clusters.
  • Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees.
  • Document architecture, deployment strategies, and operational runbooks for Kafka-based systems.
  • Participate in code reviews, knowledge-sharing sessions, and architectural discussions.

Must-Have Skills :

  • 5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka .
  • Proficiency in Java for building Kafka producers / consumers and integration with backend services.
  • Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.).
  • Experience with schema management using Confluent Schema Registry , Avro, or Protobuf.
  • Experience with CI / CD pipelines for Kafka component deployment and integration.
  • Strong collaboration skills with DevOps teams to manage Kafka infrastructure , security, and automation.
  • Solid understanding of real-time data processing concepts , fault tolerance, and data consistency.
  • Good-to-Have Skills :

  • Experience with Kafka Streams , ksqlDB , or Apache Flink for stream processing.
  • Familiarity with Kafka Connect and connectors for data ingestion and export.
  • Exposure to Confluent Kafka Platform and Kafka REST Proxy .
  • Experience with monitoring and observability tools (e.g., Grafana, ELK Stack).
  • Understanding of container orchestration platforms like Kubernetes or OpenShift.
  • Knowledge of cloud-native Kafka deployments (AWS MSK).
  • Familiarity with Spring Boot for integrating Kafka in microservice environments
  • Create a job alert for this search

    Engineer • baddi, himachal pradesh, in

    Related jobs
    • Promoted
    Senior Kubernetes Platform Engineer

    Senior Kubernetes Platform Engineer

    People Prime Worldwidebaddi, himachal pradesh, in
    Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide.Our Engineering First approach ensures we can execute all ideas and creatively ...Show moreLast updated: 30+ days ago
    • Promoted
    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    Observability Engineer (Cloud Engineer) (Otel, AWS, Grafana)

    FICObaddi, himachal pradesh, in
    FICO is seeking a Full-Stack observability Lead Engineer to design, maintain, and optimize our observability platform.The ideal candidate will be an expert in Open telemetry(Otel) instrumentation a...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Senior DevOps Engineer

    Senior DevOps Engineer

    Amura Healthbaddi, himachal pradesh, in
    We are seeking a highly skilled.AWS cloud infrastructure, automation, and modern DevOps practices.You will be responsible for architecting, implementing, and optimizing scalable, secure, and cost-e...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intelliasbaddi, himachal pradesh, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Manager-Capex

    Manager-Capex

    NouryonBaddi, Himachal Pradesh, India
    At Nouryon, our global team of Changemakers takes positive action every day, to reach higher goals collectively and individually. We create innovative and sustainable solutions for our customers to ...Show moreLast updated: 9 hours ago
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Financepanchkula, haryana, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Cloud Cost Optimization Engineer

    Cloud Cost Optimization Engineer

    techjaysbaddi, himachal pradesh, in
    What makes Techjays an inspiring place to work.At Techjays, we are driving the future of artificial intelligence with a bold mission to empower businesses worldwide by helping them build AI solutio...Show moreLast updated: 14 hours ago
    • Promoted
    Lead Coupa Architect – Source to Pay

    Lead Coupa Architect – Source to Pay

    Maitsyspanchkula, haryana, in
    As part of the Digital Core Transformation team, you will design and implement Coupa and SAP S / 4HANA capabilities supporting global Procurement processes. The role requires experience in solution de...Show moreLast updated: 1 day ago
    • Promoted
    Senior Devops Engineer

    Senior Devops Engineer

    Datavidpanchkula, haryana, in
    Datavid provides enterprise-ready software solutions designed to help businesses extract, enrich, and utilize their most valuable knowledge. Our focus is on delivering cutting-edge data engineering ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Azure Kubernetes Service (AKS) Architect

    Azure Kubernetes Service (AKS) Architect

    Capgeminipanchkula, haryana, in
    Azure Kubernetes Service (AKS) clusters.AKS cluster security, scalability, and performance optimization.AKS with CI / CD pipelines for automated deployments. RBAC, secrets management, and compliance s...Show moreLast updated: 10 hours ago
    • Promoted
    GTM Engineer

    GTM Engineer

    Scalantecpanchkula, haryana, in
    GTM Engineer (m / f / d) – Full Time, Remote.We’re looking for a GTM Engineer to help us build, automate and scale the outbound and growth systems behind our clients’ sales pipelines.You’ll work at the...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Digital Collaboration Engineer

    Senior Digital Collaboration Engineer

    TELUS Digitalpanchkula, haryana, in
    Role : Senior Digital Collaboration Engineer (Google Workspace Engineer).Work Location : Gift City, Gandhinagar OR Noida OR Banglore (100% Onsite). Working Mode : 5 Days Work from office.Shift Timings : ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    ETL Architect

    ETL Architect

    Tata Consultancy Servicespanchkula, haryana, in
    Notice period- 0 to 6 o Days or Serving NP.Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices.Data Warehou...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Backend Engineer

    Senior Backend Engineer

    VDEXbaddi, himachal pradesh, in
    VDEX is a rapidly-growing perpetual exchange powered by zero knowledge state channels.The exchange recently surpassed $2 billion in volume and is incubated by Binance Labs.Responsibilities and Requ...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC Groupbaddi, himachal pradesh, in
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Technical Team Lead

    Technical Team Lead

    Xebiapanchkula, haryana, in
    Should be able to think architecturally, lead team of Sr.Mid-level FS Engg, Review their approach.React Js mix can be in any proportion. Equally good in both is not expected.Xebia is a global and so...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    Vsynergize AIbaddi, himachal pradesh, in
    Responsibilities & Required Skills : .Design, deploy, and manage core AWS resources (EC2, S3, RDS / Aurora, Lambda,.Build, maintain, and version infrastructure using Terraform (S3 / DynamoDB remote state...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incbaddi, himachal pradesh, in
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 14 hours ago