Getting Data In

Prevent log events with specific text string from indexing

cwwirth
Explorer

I've got a seemingly simple problem that I'm having a bit of difficulty on. I've been tasked with excluding log events containing a specific text string (in this case, an IP address) from being indexed in Splunk. I've done similar with sources such as Windows event logs (using props.conf and transforms.conf to send to nullQueue based on a regex), but the catch this time is that the event could come from any host, and be any sourcetype. Basically, "if any event comes into Splunk with this text string, send it to nullQueue." Any ideas?

0 Karma
1 Solution

Ayn
Legend

Just do as you've done previously, and make use of that you can use the [default] stanza in props.conf to have transforms apply to all events.

View solution in original post

bmacias84
Champion

Hello, You should be able to use the same method using your props.conf and transforms.conf. Except this time you will define a your transfrom under default stanza in your props.conf. The transform should be applied to all stanza in your props.conf.


#props.conf
[default]
TRANSFORMS-remove_events = ipremove

Hope this helps or gets you started. Dont forget to vote up and accept answers.

Cheers

kristian_kolb
Ultra Champion

According to the docs for props.conf, you can set global settings under the stanza called default instead of a source/sourcetype/host.

http://docs.splunk.com/Documentation/Splunk/latest/Admin/Propsconf

props.conf

[default]
TRANSFORMS-who_did_it = dunno

transforms.conf

[dunno]
REGEX = <insert your ip>
DEST_KEY = queue
FORMAT = nullQueue

I have never done this (and to be honest, it sounds a bit like someone wanting to cover his/her tracks :), but I can't see why it shouldn't work.

/Kristian

Ayn
Legend

Just do as you've done previously, and make use of that you can use the [default] stanza in props.conf to have transforms apply to all events.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Classic British Rock Bands

This puzzle series (first published here) is based on extracting information from statements about well-known ...

New to the Community? Join Us for an Exclusive Post .conf26 Welcome Session (Plus a ...

Keep the .conf26 Energy Going: Welcome to the Splunk Community! Whether we scanned your badge at the Community ...

Accelerate Splunk App Development with AI

  Learn how to automate the repetitive parts of your build cycle.   Register to Attend   Join our Tech Talk ...