Splunk Search

locating dead hosts

rbellini
Explorer

I am trying to get a report of all hosts that have not reported any events in the last 2 hours. I am using:

| metadata type=hosts | search totalCount >0 AND lastTime < now-2h

It only reports hosts that have a totalCount >0 yet it ignores the lastTime qualifier.

Any suggestions?

Thank you!

Tags (1)
0 Karma

jonuwz
Influencer
| metadata type=hosts totalCount >0 | where lastTime < relative_time(now(),"-2h")

now() is only available in eval and where clauses.

You could not use relative_time() and just instead use now()-(60*60*2)

rbellini
Explorer

This also worked:

| metadata type=hosts | where lastTime <(now()-7200) AND totalCount >0

0 Karma

rbellini
Explorer

This almost worked! I made one minor change:

| metadata type=hosts | where lastTime < relative_time(now(),"-2h") AND totalCount >0

Thank you!

0 Karma

yannK
Splunk Employee
Splunk Employee

My method is to save a list of the hosts with a scheduled lookup, that updated every week
then use it in a join to compare to the list of the hosts who sent data in the last hour.

generate the lookup with last week hosts
earliest=-7d@d latest=-14d@d, scheduled to run every week

* | stats count AS previouscount by host | outputlookup host_previousweek.csv

scheduled test to compare to current hosts. (like last 2 hours)

| inputlookup host_previousweek.csv | JOIN type=outer host
[ search * | stats count AS currentcount by host ]
| eval check_test=if(isnull(currentcount),"missing",if(isnull(previouscount),"new","present"))
| WHERE check_test="missing"

And alert on missing.
If you need to update the host lookup, run it manually

rbellini
Explorer

This presents a totall new concept on locating missing hosts!

Thanks!

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Observability Simplified: Combining User Experience, Application Performance & ...

Tech Talk Observability Simplified: Combining User Experience, Application Performance & Network ...

Event Series May & June: From Network Visibility to Service Intelligence

Unifying the Network: Moving from Alert Noise to Service Intelligence with Splunk ITSI In today’s hybrid ...

Global Splunk User Group Events: May + June 2026

Your Splunk Community Awaits: Discover Upcoming User Group Events Worldwide    Staying ahead in the fast-paced ...