Getting Data In

How to blacklist files with a wildcard in monitoring stanza?

Ashwini008
Builder

Hi,

I need to index  windows server logs and blacklist all the previous year logs.

Inputs.conf.

[monitor://E:\application\logs\server*]
disabled=0
sourcetype=_error_text
index=_error_file

Logs in the servers looks like below

Ashwini008_0-1673007673369.png

I refered solunk doc and came up with this stanza but it says only the last filter will be applied. Does it mean only 2019 blacklist regex will be applied?

[monitor://E:\application\logs\server*]
disabled=0
sourcetype=_error_text
index=_error_file
blacklist.1=^server-2021-\d{2}-\d{2}
blacklist.2=^server-2020-\d{2}-\d{2}
blacklist.3=^server-2019-\d{2}-\d{2}

Ashwini008_0-1673013043172.png

 

Please suggest.

0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

Monitor stanzas support a single blacklist setting.  That's why you get the message about only the last one being applied.  Contrast this with the blacklists for wineventlog stanzas.

Blacklists use regular expressions.  There is no concept in regex for "not this year" or "< 2023", etc.

I suggest using a whitelist for the current year, instead.  Something like this

whitelist = server-202[34]-\d\d-\d\d

will match files created this year and next (giving you time to update it at the end of 2023).

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

Monitor stanzas support a single blacklist setting.  That's why you get the message about only the last one being applied.  Contrast this with the blacklists for wineventlog stanzas.

Blacklists use regular expressions.  There is no concept in regex for "not this year" or "< 2023", etc.

I suggest using a whitelist for the current year, instead.  Something like this

whitelist = server-202[34]-\d\d-\d\d

will match files created this year and next (giving you time to update it at the end of 2023).

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

.conf25 Community Recap

Hello Splunkers, And just like that, .conf25 is in the books! What an incredible few days — full of learning, ...

Splunk App Developers | .conf25 Recap & What’s Next

If you stopped by the Builder Bar at .conf25 this year, thank you! The retro tech beer garden vibes were ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...