Deployment Architecture

Does the Universal forwarder index events?

tim9gray
Explorer

Does the universal forwarder index events like splunk does? Here is the scenario I a curious about - if I am using Splunk with a universal forwarder(s) and I want to do a clean all to dump all my event data(this is just while I am playing around testing queries and stuff) from Splunk, will the Universal forwarder recognize this and resend the events that Splunk is now missing?

Do I have to do something similar with the Universal forwarder? If the forwarder is running on windows and as a service, how would I do this if necessary? - Would I stop the service and then run it manually with the appropriate command line arguments?

1 Solution

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

View solution in original post

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

ChrisG
Splunk Employee
Splunk Employee

Just as a reference, there is a docs topic that discusses the different types of forwarders: http://docs.splunk.com/Documentation/Splunk/5.0.4/Deploy/Typesofforwarders

Get Updates on the Splunk Community!

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...

Updated Team Landing Page in Splunk Observability

We’re making some changes to the team landing page in Splunk Observability, based on your feedback. The ...

New! Splunk Observability Search Enhancements for Splunk APM Services/Traces and ...

Regardless of where you are in Splunk Observability, you can search for relevant APM targets including service ...