Deployment Architecture

Does the Universal forwarder index events?

tim9gray
Explorer

Does the universal forwarder index events like splunk does? Here is the scenario I a curious about - if I am using Splunk with a universal forwarder(s) and I want to do a clean all to dump all my event data(this is just while I am playing around testing queries and stuff) from Splunk, will the Universal forwarder recognize this and resend the events that Splunk is now missing?

Do I have to do something similar with the Universal forwarder? If the forwarder is running on windows and as a service, how would I do this if necessary? - Would I stop the service and then run it manually with the appropriate command line arguments?

1 Solution

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

View solution in original post

rturk
Builder

Hi Tim,

The Universal Forwarder does not index data, only collecting and forwarding it to an upstream indexer.

What the forwarder does do is keep track of log file events it has sent as part of the internal _fishbucket index. This keeps track of where in a log file Splunk is up to for the purposes of forwarding only new events. If you want to tell the Forwarder to send all events again, you can clean out the _fishbucket using the following command:

splunk clean eventdata _thefishbucket

Just keep in mind, this will result in duplicate data upstream if it's already been indexed.

Hope this helps 🙂

ChrisG
Splunk Employee
Splunk Employee

Just as a reference, there is a docs topic that discusses the different types of forwarders: http://docs.splunk.com/Documentation/Splunk/5.0.4/Deploy/Typesofforwarders

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...

Data Persistence in the OpenTelemetry Collector

This blog post is part of an ongoing series on OpenTelemetry. What happens if the OpenTelemetry collector ...

Thanks for the Memories! Splunk University, .conf25, and our Community

Thank you to everyone in the Splunk Community who joined us for .conf25, which kicked off with our iconic ...