Getting Data In

The file count for my monitored directory is higher than expected. Is my (black|white)list not being taken into account?

hexx
Splunk Employee
Splunk Employee

When I look in Manager >> Data Inputs >> Files & Directories, the entry for the monitored directory I have defined with a (white|black)list shows a count of "number of files" much higher than expected. In fact, that count is equal to all files and directories to be found recursively in the monitored directory, seemingly disregarding my (white|black)list setting!

1 Solution

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

View solution in original post

Afef
Communicator

Hi,
Please Could someone tell me how to count the number of files and directories in a folder in splunk ?
Regards

0 Karma

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

hulahoop
Splunk Employee
Splunk Employee

I guess monitoring does not necessarily mean indexing.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Thanks for the Memories: .conf26 Took Learning to New Heights

Thank you, Splunk Community, for making .conf26 in Denver one for the books. From packed Splunk University ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...