Getting Data In

The file count for my monitored directory is higher than expected. Is my (black|white)list not being taken into account?

hexx
Splunk Employee
Splunk Employee

When I look in Manager >> Data Inputs >> Files & Directories, the entry for the monitored directory I have defined with a (white|black)list shows a count of "number of files" much higher than expected. In fact, that count is equal to all files and directories to be found recursively in the monitored directory, seemingly disregarding my (white|black)list setting!

1 Solution

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

View solution in original post

Afef
Communicator

Hi,
Please Could someone tell me how to count the number of files and directories in a folder in splunk ?
Regards

0 Karma

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

hulahoop
Splunk Employee
Splunk Employee

I guess monitoring does not necessarily mean indexing.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Observability Simplified: Combining User Experience, Application Performance & ...

Tech Talk Observability Simplified: Combining User Experience, Application Performance & Network ...

Event Series May & June: From Network Visibility to Service Intelligence

Unifying the Network: Moving from Alert Noise to Service Intelligence with Splunk ITSI In today’s hybrid ...

Global Splunk User Group Events: May + June 2026

Your Splunk Community Awaits: Discover Upcoming User Group Events Worldwide    Staying ahead in the fast-paced ...