Monitoring Splunk

How to get to know peer down time with SPL?

brandy81
Path Finder

Hi Guru! (I edited)

I have indexer cluster and one search head. I do not use monitoring console. One of peer nodes has been shutdown and the server as well. It seems that the indexer has been shut down due to OS issue.

How am I able to get to know the exact shutdonw time using SPL? I would be index=_internal.... . Could you please help me out?

Labels (2)
0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @brandy81,
I don't know if this solution could answer to your need:

| metasearch index=_internal 
| timechart span=10m count BY host
| where count=0
| delta _time AS diff
| where diff=600
| stats sum(diff) AS total

In this way you have the sum (in seconds) of all the periods without internal logs, that means Splunk not active.
You can also calculate a percentage with the analysis period (e.g. 24 hours).

Ciao.
Giuseppe

venkateshparank
Path Finder

Can you try below query ?

index=_internal source="/opt/splunk/var/log/splunk/splunkd.log" component=CMPeer peer_name="ADD_YOUR_PEER_NAME_HERE" to=Stopped

OR

index=_internal component=CMPeer peer_name="ADD_YOUR_PEER_NAME_HERE" stop*

0 Karma

brandy81
Path Finder

@venkateshparankusam Hi, Thank you sooooo much for your response. The instances are not able to access remotely, so please let me check within a couple of days. I will let you know the result and accept your answer. Hope it would work. Thank you again.

0 Karma
Get Updates on the Splunk Community!

Splunk Observability Synthetic Monitoring - Resolved Incident on Detector Alerts

We’ve discovered a bug that affected the auto-clear of Synthetic Detectors in the Splunk Synthetic Monitoring ...

Video | Tom’s Smartness Journey Continues

Remember Splunk Community member Tom Kopchak? If you caught the first episode of our Smartness interview ...

3-2-1 Go! How Fast Can You Debug Microservices with Observability Cloud?

3-2-1 Go! How Fast Can You Debug Microservices with Observability Cloud? Learn how unique features like ...