Monitoring Splunk

push a file to the top of the monitoring queue after restart

jaoui
Path Finder

I have several thousand files that are being monitored with a stanza like the following:
[/files//.log]

when i restart splunkd it begins to go through all the files to catch up where it left off with messages like:
05-21-2012 16:32:46.927 -0700 INFO WatchedFile - Will begin reading at offset=279956 for...

Since there are so many files, I was wondering if there is a way to manually push a file into the "next to be read" queue in case i have a user requesting immediate data?

0 Karma

lguinn2
Legend

There is a way to do something like that, though not exactly what you are asking:

[monitor:///var/log/veryimportant.log]

[monitor:///var/log]
blacklist=veryimportant.log

A critical rule to remember is - you cannot have two identical monitor stanzas.

Since veryimportant.log is specifically named, it will be found "directly" and monitored. Splunk will iterate over the other files in /var/log, so it will probably take longer to index the updates for them. I don't know that this is guaranteed, but try it.

0 Karma
Get Updates on the Splunk Community!

Built-in Service Level Objectives Management to Bridge the Gap Between Service & ...

Wednesday, May 29, 2024  |  11AM PST / 2PM ESTRegister now and join us to learn more about how you can ...

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer at Splunk .conf24 ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...

Share Your Ideas & Meet the Lantern team at .Conf! Plus All of This Month’s New ...

Splunk Lantern is Splunk’s customer success center that provides advice from Splunk experts on valuable data ...