Talent.com
Observability Engineer - Splunk/Kafka
Observability Engineer - Splunk/KafkaJobhedge Consultancy • Pune
Observability Engineer - Splunk / Kafka

Observability Engineer - Splunk / Kafka

Jobhedge Consultancy • Pune
23 days ago
Job description

Description :

Job Description : AI-Driven Observability Engineer

Experience : 10+ Years

About the Role :

We are seeking a highly skilled AI-Driven Observability Engineer to design, implement, and maintain end-to-end observability solutions for infrastructure and application. You will play a key role in ensuring the reliability, performance, and scalability of our distributed systems by developing monitoring, logging, and tracing capabilities. The ideal candidate will have expertise in ETL, Data Science, and Machine Learning, along with hands-on experience in OpenTelemetry, Splunk, Kafka for comprehensive observability.

Key Responsibilities :

  • Design & Develop Observability Solutions : Build and enhance telemetry pipelines for logs, metrics, and traces using industry-standard tools (kafka, OpenTelemetry, Splunk)
  • Instrument Applications : Implement observability best practices in infrastructure, applications and platforms.
  • Design and Implement machine learning models to analyze logs, metrics and traces for anomaly detection, predictive failure analysis and root cause analysis.
  • Monitor & Analyze System Performance : Build and Develop real-time data visualization dashboards and alerts to track system health, detect anomalies, and support real-time troubleshooting.
  • Work with Event-Driven Architectures : Integrate observability with messaging systems like Kafka, RabbitMQ, or Pulsar for real-time monitoring.
  • Collaborate Across Teams : Work closely with SREs, DevOps, and development teams to improve system reliability and incident response.
  • Security & Compliance : Ensure observability data is securely stored and compliant with relevant regulations (GDPR, HIPAA, etc.).
  • Optimize Performance : Conduct root cause analysis and improve system observability to reduce downtime and improve response times.

Required Skills & Experience :

  • Data Science & Machine Learning experience : Hands-on proficiency in Python, TensorFlow, PyTorch, Scikit-learn, Pandas, NumPy.
  • Extensive knowledge of ETL techniques : Data extraction, transformation, and loading using Apache Airflow, Apache NiFi, Spark or similar tools
  • Observability Stack : Hands-on experience with Prometheus, Grafana, ELK Stack, Loki, OpenTelemetry, Jaeger, or Zipkin.
  • Experience with Time-Series Analysis, Predictive Analytics and AI-driven Observability.
  • Cloud & Infrastructure : Experience with AWS, Azure, or GCP observability services (e.g., CloudWatch, Azure Monitor).
  • Distributed Systems & Microservices : Understanding of Kubernetes, Docker, and Service Mesh technologies (Istio, Linkerd).
  • Event-Driven Architectures : Experience with Kafka, RabbitMQ, or other message brokers.
  • Database & Storage : Familiarity with time-series databases (InfluxDB, VictoriaMetrics) and NoSQL / SQL databases.
  • Preferred Qualifications :

  • Experience in AIOps and intelligent observability or anomaly detection.
  • Knowledge of Chaos Engineering for resilience testing.
  • Certifications in AWS, Azure, Kubernetes, or Observability tools.
  • Knowledge of data engineering and big data technologies like Hadoop, Spark and Flink.
  • Experience with machine learning models for predictive observability.
  • Why Join Us ?

  • Work on cutting-edge observability solutions in a high-scale production environment.
  • Opportunity to automate infrastructure monitoring and enhance system resilience.
  • Collaborate with cross-functional teams to improve reliability engineering.
  • Competitive salary, benefits, and growth opportunities in a fast-paced environment.
  • (ref : hirist.tech)

    Create a job alert for this search

    Observability Engineer • Pune

    Related jobs
    Launch Engineer

    Launch Engineer

    Varroc • Pune, Maharashtra, India
    Operational & financial performance Monitoring and reporting.Facilitating optimization of Launch Cost, quality and timelines of projects. Ensure smooth handover of the new product to the production ...Show more
    Last updated: 15 days ago • Promoted
    Solution Engineer o9

    Solution Engineer o9

    Tech Mahindra • Pune, Maharashtra, India
    Solution Engineer, Supply Chain Application Delivery – Planning.The Planning Configuration Analyst needs to quickly understand complex APO-BI-o9 requirements and create appropriate solutions.They s...Show more
    Last updated: 12 days ago • Promoted
    PLC Engineer

    PLC Engineer

    ABB • Pune, Maharashtra, India
    This job is with ABB, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.At ABB, we help indu...Show more
    Last updated: 17 days ago • Promoted
    Emulation Engineer / Lead

    Emulation Engineer / Lead

    eInfochips (An Arrow Company) • Pune, IN
    Role : Emulation Engineer / Lead.Job Location : Noida, Chennai, Bangalore, Hyderabad, Ahmedabad.You must be having BS or MS in Electrical OR Electronics engineering. Minimum 4+ Years of Emulation Expe...Show more
    Last updated: 30+ days ago • Promoted
    Emulation Engineer

    Emulation Engineer

    Semi leaf • Pune
    Job Summary : We are seeking a highly skilled Emulation Engineer with strong experience in pre-silicon validation and hardware emulation platforms such as Palladium, ...Show more
    Last updated: 17 days ago • Promoted
    Synthetic Monitoring Engineer

    Synthetic Monitoring Engineer

    Capgemini • Pune, MH, IN
    Quick Apply
    Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premium well over US$25 Billion (P&C).They proud...Show more
    Last updated: 30+ days ago
    AWS Engineer

    AWS Engineer

    Spryc Systems • Pune, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 25 days ago • Promoted
    GTM Engineer

    GTM Engineer

    FullFunnel • Pune, IN
    At FullFunnel, we don’t believe growth should rely on manual grind—we believe in.That’s why we’re looking for a.This is not your average ops role. If you geek out on solving complex system puzzles a...Show more
    Last updated: 30+ days ago • Promoted
    Supplier Quality Engineer-Pune

    Supplier Quality Engineer-Pune

    Danaher • Pune, Maharashtra, India
    This job is with Danaher, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Are you ready to...Show more
    Last updated: 14 days ago • Promoted
    Sr. Engineer Comp Design

    Sr. Engineer Comp Design

    Rolls-Royce • Pune, Maharashtra, India
    This job is with Rolls-Royce, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Job Descript...Show more
    Last updated: 18 days ago • Promoted
    GTM Engineer

    GTM Engineer

    nRev • Pune, India
    NRev is in true zero-to-one territory : we’re building an AI-powered Revenue Orchestration platform that lets GTM teams spin up custom agents to automate, enrich, and accelerate every step of the en...Show more
    Last updated: 30+ days ago • Promoted
    DynaTrace Observability Engineer

    DynaTrace Observability Engineer

    INDIGLOBE IT SOLUTIONS PRIVATE LIMITED • Pune
    Job Description : Key Responsibilities : - Set up, configure, and manage Dynatrace agents across on-premises, AWS, and Kubernete...Show more
    Last updated: 27 days ago • Promoted
    Observability & Automation Consultant Datadog SME

    Observability & Automation Consultant Datadog SME

    Zensar Technologies • Pune, Maharashtra, India
    Tools & Integration Automation Datadog SME Location : Pune / Hyderabad / Bangalore Experience in years : 12-15 years We are looking for a seasoned Observability & Infrastructure Automation Consultant ...Show more
    Last updated: 24 days ago • Promoted
    Supplier Quality Engineer

    Supplier Quality Engineer

    PROSE Technologies • Pune, Maharashtra, India
    Responsible for ensuring supplier quality compliance for mechanical components, focusing on Die Casting, Injection Moulding, and Plating parts. Conduct supplier process audits, product inspections, ...Show more
    Last updated: 19 days ago • Promoted