Getting Data In

The file count for my monitored directory is higher than expected. Is my (black|white)list not being taken into account?

hexx
Splunk Employee
Splunk Employee

When I look in Manager >> Data Inputs >> Files & Directories, the entry for the monitored directory I have defined with a (white|black)list shows a count of "number of files" much higher than expected. In fact, that count is equal to all files and directories to be found recursively in the monitored directory, seemingly disregarding my (white|black)list setting!

1 Solution

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

View solution in original post

Afef
Communicator

Hi,
Please Could someone tell me how to count the number of files and directories in a folder in splunk ?
Regards

0 Karma

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

hulahoop
Splunk Employee
Splunk Employee

I guess monitoring does not necessarily mean indexing.

Get Updates on the Splunk Community!

.conf24 | Day 0

Hello Splunk Community! My name is Chris, and I'm based in Canberra, Australia's capital, and I travelled for ...

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

(view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...