Splunk Search

TriggerTime eval with SolarWinds Index

daviswk
Observer

I am creating a dashboard with Splunk to monitor offline assets in my environment with SolarWinds. I have the add-on and incorporate solarwinds:nodes and solarwinds:alerts into my query. I am running into an issue where I cant get the correct output for how long an asset has been down.  In SolarWinds you can see Trigger time in the Alert Status Overview. This shows the exact date and time the node went down. 

I cannot find a field from the raw data between both sourcetypes that will give me that output. I want to use eval to show how much time has passed since the trigger.

Does anyone know how to achieve this? 

 

 

Labels (3)
0 Karma

PickleRick
SplunkTrust
SplunkTrust

I'm not sure if I understand your question properly. Are you asking how to find a timestamp which is not included in the data you have? Well, if it's not there you need to make sure it's exported from the source somehow. It's more a Solarwinds question than a Splunk one.

0 Karma

dural_yyz
Motivator

@PickleRick is correct if the data is not in the logs you can't eval from nothing.

That said one way we have combated down time in the past is calculating the duration since the last anything log entry from the host.  This is never really 100% because it could be a transport issue but the asset is still alive, or any number of other things where the asset is alive but not 'logging'.  However, any calculation of x>acceptable duration of the last log is always a good thing to know.  Pair that up with a good CMDB record to prevent tracking decommissioned assets.

There are many alternatives to lack of quality data, but they each come with pros and cons to be accounted for.

PickleRick
SplunkTrust
SplunkTrust

Of course, checking when there are "missing" events is one of possible ways of checking uptime. But that's a completely different problem.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...

SplunkTrust Application Period is Officially OPEN!

It's that time, folks! The application/nomination period for the 2026-2027 SplunkTrust is officially open. If ...