Splunk Search

Is there a way to search which heavy forwarder sent a log to the indexer?

galwood
New Member

Is there a way to search a log and figure out which heavy forwarder sent the log to the indexer?

0 Karma

jlanders
Path Finder

Had a need for this today. This search does the trick for me:

index=_internal (host=myheavyforwarder1 OR host=myheavyforwarder2 OR host=myheavyforwarder3) sourcetype=splunkd "group=tcpin_connections" component=Metrics | timechart span=30m dc(hostname) by host

From this, I can see the distinct count of hostnames flowing through each heavy forwarder...

jlanders
Path Finder

Btw, if you were to dig into these metrics, you could infer other things... like which logs went through which heavy forwarder by looking at group=per_source_thruput series="your source". The key is "infer" because your universal forwarders should load balance through your heavy forwarders and most logs will go through all of them.

With the combination of the per source thruput and a rough timeframe though, you could take a good guess.

0 Karma

somesoni2
Revered Legend

I would say it depends on how you've setup log monitoring.

a)If you're not overriding the host, the host field in your log will denote the forwarder which is collected it.

your base search | stats count by host | table host

b) If you're overriding the host, then find the host (overridden) value in your logs and search for corresponding logging server in metrics logs

index=_internal sourcetype=splunkd source=*metrics.log group=per-host_thruput series="hostValueFromYourLog" | stats count by host | table host
0 Karma
Get Updates on the Splunk Community!

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...

September Community Champions: A Shoutout to Our Contributors!

As we close the books on another fantastic month, we want to take a moment to celebrate the people who are the ...

Splunk Decoded: Service Maps vs Service Analyzer Tree View vs Flow Maps

It’s Monday morning, and your phone is buzzing with alert escalations – your customer-facing portal is running ...