Getting Data In

File system changes (not log monitoring)

tyronetv
Communicator

Have an environment where a directory is used to 'stage' files waiting for an update. Essentially, a file is sent to a vendor and a local status file (of zero or more bytes) is placed in a 'pending' directory. Once the vendor has completed their work and a good return is received the local status file is moved to the 'done' directory. (This is done so a second process can use the listing to determine what status file to check for on it's run).

What I want to do is monitor the '/pending' directory for new files only being worried about WHEN they showed up. Then, if they haven't 'moved' in a predetermined amount of time (depending upon environment this could be two - eight hours) raise an alert. This would also allow me to say "_time seen" and "_time gone" to build some metrics on vendor performance.

All that being said, I am having issues getting it set up to forward from my linux universal forwarder. My inputs.conf stanza looks like:

[fschange:/path/to/dir/]

signedaudit = false

index=_audit

I read that in one of the previous 'answers' questions. Unfortunately, I am seeing no records in _audit or _internal for that host using the search head.

Ideas?

Tags (2)
0 Karma

lguinn2
Legend

You should not be putting data in _audit, that is an internal index for Splunk to index its own events. I know that there is some stuff in the documentation that talks about this index, but unless you have already done all the other auditing setup, it isn't going to work.

Create a new index - you could call it audit and send data to that index instead.

[fschange:/path/to/dir/]
index=audit

Also, this feature is deprecated: Monitor changes to your filesystem

You can still use it, but it might go away.

0 Karma
Get Updates on the Splunk Community!

Announcing the Expansion of the Splunk Academic Alliance Program

The Splunk Community is more than just an online forum — it’s a network of passionate users, administrators, ...

Learn Splunk Insider Insights, Do More With Gen AI, & Find 20+ New Use Cases You Can ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Buttercup Games: Further Dashboarding Techniques (Part 7)

This series of blogs assumes you have already completed the Splunk Enterprise Search Tutorial as it uses the ...