Getting Data In

Relation between fishbuckets and check point files.

sunrise
Contributor

Hi Splunkers,

I know that Universal Forwarder monitoring windows eventlog has a check point file and fishbuckets.
In re-transferring data to the Indexer, we have two cases.

For example, it seems to be two cases.
1. Delete fishbuckets, not changing check points files.
2. Change check point files, not deleting fishbuckets.

Case 1, in default setting, UF seems to transfer all local eventlog to Indexer.

Case 2, we actually can set a record ID from which start to read.

But I cannot understand these logic.
Does UF read check point file and start transferring data irrelevant to fishbuckets ?
Or does UF not transfer data in spite of changing the check point file because of fishbuckets ?

Thak you for your help.

0 Karma
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

Checkpoint files are used to track position in the windows event logs. The fish bucket is used to track position in files (read by the monitor:// input processor). A particular input type uses either one or the other.

View solution in original post

gkanapathy
Splunk Employee
Splunk Employee

Checkpoint files are used to track position in the windows event logs. The fish bucket is used to track position in files (read by the monitor:// input processor). A particular input type uses either one or the other.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...