Getting Data In

How can we find the Heavy Forwarders data flow?

ddrillic
Ultra Champion

We have two Heavy Forwarders through which quite a bit of data is flowing through. We have access to the back end, such as to the metrics logs but not to the UI. How can we find out the daily amount of data which goes through these heavy forwarders?

Tags (2)
0 Karma

woodcock
Esteemed Legend

Assuming that you named your HF tier differently than your Indexer tier, you can use a search like this:

index=_internal AND component=Metrics tcpout* | stats values(name) dc(name) AS options BY host | sort 0 options

Zane
Explorer

Hi there,

i'm a new splunker

I'd like to know what's means of these search result, such as "management", "default-autolb-group:xxx.xxx.xxx.xxx:9997:3:1" i can understand there is my HF ip and port, but what's means of :3:1, I have seen :0:0, :0:1....

thanks in advance.

@woodcock 

0 Karma

yannK
Splunk Employee
Splunk Employee

You can look in the metrics.log of the HWF how much they received.
And you can look on the next level indexer how much they received form the forwarders (and group them per type)

example for the volume received by the indexers per forwarder type. (full = heavy forwarder)

        index=_internal  host=*myindexer*  source=*metrics.log* group=tcpin_connections fwdType| stats sum(kb) by hostname fwdType
0 Karma

somesoni2
SplunkTrust
SplunkTrust

YOu can run CLI searches to those metrics logs to get the data you want (provided you've Splunk credentials with permission to view _internal index).
https://docs.splunk.com/Documentation/Splunk/7.1.1/Troubleshooting/Aboutmetricslog

ddrillic
Ultra Champion

Most cheerful @somesoni2 - thank you.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...