Trying to properly format a blacklist for imported files.

mpresseau — Wed, 30 Sep 2020 05:36:19 GMT

I have configured multiple Data Inputs, pointing at folders such as /mnt/DataInput1 etc. There is a lot of noise so tried following the following links to add a blacklist to the inputs.conf for the input, to restrict junk data such as Level=INFO type linux data.
https://docs.splunk.com/Documentation/Splunk/latest/Data/Whitelistorblacklistspecificincomingdata?r=searchtip

Example input:
[monitor:///mnt/blob/XXXXXXXXXX/logs]
disabled = false
index = customer_XXXX_XXXXXXXX
blacklist = Level="(INFO)"

Unfortunately after several tries, and after making a change, restarting Splunk to see the change, then waiting several hours for the Data Inputs page to queue up the number of files, it still doesn't work.

Can anyone please shed some insight into what I'm doing wrong please?
Ultimately I'd like to do something like:

blacklist = Level="(INFO)"|coderef="(salt*)|"consul)"

Where as you can see above, I want to blacklist =different event types.

Help?

Re: Trying to properly format a blacklist for imported files.

richgalloway — Mon, 01 Jun 2020 21:08:18 GMT

That's not what blacklisting does. The blacklist feature in a monitor statement tells Splunk to ignore any file that matches the given expression. It's often used to skip .gz files, for example.

Filtering certain events within a file is a different feature, which is implemented using transforms. See https://answers.splunk.com/answers/719162/how-do-i-use-propsconf-and-transformsconf-to-filte.html

topic Trying to properly format a blacklist for imported files. in Getting Data In

Trying to properly format a blacklist for imported files.

Re: Trying to properly format a blacklist for imported files.