Getting Data In

Where does the Universal forwarder cache its data if the indexer is down?

aberdamy
Explorer

Where does the Universal forwarder cache its data if the indexer is down?

0 Karma

linu1988
Champion

Hello,
The data is stored in memory before it's sent. If the indexer is down and you have not specified any explicit path to store the pending data that data will be gone.

You may want to take a look at persistent queue subject and i am gonna sleep.

http://docs.splunk.com/Documentation/Splunk/5.0.2/Deploy/Protectagainstlossofin-flightdata

http://docs.splunk.com/Documentation/Splunk/latest/Data/Usepersistentqueues

Thanks

linu1988
Champion

if you see the document there it is mentioned how to configure the output in-memory queue. But as the secondary memory is more cheaper it should be used as persistent queue. For more in-memory queue length it should be configured as below.

maxQueueSize = [<integer>|<integer>[KB|MB|GB]]

0 Karma

aberdamy
Explorer

ok thank you for the reply. it looks like I cannot use the persistent queue for my Windows events or the Monitor Stanza so is there any way to increase the 'in memory' queue for the universal forwarder?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Meet the .conf26 AI Agent Buildathon Winners

At the .conf26 AI Agent Buildathon, Splunk users turned their operational expertise into working AI agents ...

Trusted Autonomy in the SOC: A Maturity Journey

AI is compressing attacker timelines and pushing SOC teams beyond human capacity thresholds. The next SOC ...

Supercharging Windows Security Detection Performance: Introducing Hybrid Field ...

Windows event logs—from Security auditing and Sysmon to PowerShell script blocks—form the operational backbone ...