Splunk IT Service Intelligence

Why is ITSI ServiceHeathScore showing incorrect health score?

AKG11
Path Finder

Hello,

We have recently started using ITSI and noticed that some false service health degradation alerts are getting generated.  when we checked the deep dive in some cases all the KPI under service are green but still overall health shown yellow and some times red.

Trying to understand the behavior.

AKG11_0-1686245009209.png

Thanks
Ankit

Labels (2)
Tags (3)
0 Karma

srauhala_splunk
Splunk Employee
Splunk Employee

Hi! 

The deep dives does a roll up of the data depending on the time span selected. To review the KPI health in details look at the itsi summary index.  

index=itsi_summary [|`service_kpi_list` | search service_name="my_service_name" kpi_name=my_kpi | fields kpiid | format ]
| lookup service_kpi_lookup _key as itsi_service_id OUTPUT title as service_name
| table _time kpi, alert_*, entity_* service*,indexed_is_service_aggregate

 

0 Karma
Get Updates on the Splunk Community!

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...

Adoption of Infrastructure Monitoring at Splunk

  Splunk's Growth Engineering team showcases one of their first Splunk product adoption-Splunk Infrastructure ...

Modern way of developing distributed application using OTel

Recently, I had the opportunity to work on a complex microservice using Spring boot and Quarkus to develop a ...