Getting Data In

Filtering/nullQueue Question

kmcconnell
Path Finder

I’m trying to get our AIX data into Splunk, but I’m having a filter/nullQueue issue. I was wanting to keep certain events and nullQueue everything else. Below is the props and transform. Right now everything is going into the index. Am I going about this the wrong way? The filtering is done on a heavy forwarder.

props.conf
[AIX]
TRANSFORMS-sec=sec_keepevent,sec_nullqueue

transforms.conf
[sec_keepevent]
REGEX = (sshd\[\d*\]:)|( su:)|( sudo:)|( failed:)
DEST_KEY = queue
FORMAT = indexQueue

[sec_nullqueue]
REGEX = (.*)
DEST_KEY = queue
FORMAT = nullQueue

Tags (2)
0 Karma

kristian_kolb
Ultra Champion

Hi,

Yes you are going about it in the wrong way - literally 🙂

You need to change the order in which the transforms are called from props.conf.

TRANSFORMS-sec = sec_nullqueue, sec_keepevents

The transforming takes the events through all transforms before returning them for further processing/indexing. Thus the nullQueue must come first.

lguinn might be right on the REGEX, though.

/k

kristian_kolb
Ultra Champion

And make sure that you're doing it under the correct props.conf stanza. Anything under [AIX] will only match if the sourcetype is called AIX.

0 Karma

kristian_kolb
Ultra Champion

You might also want to take a look here;

http://wiki.splunk.com/Where_do_I_configure_my_Splunk_settings

since with your current config, if it was in the right place, all events would be discarded.

Also, these changes only apply to incoming traffic, it will not alter existing events in an index.

/k

0 Karma

lguinn2
Legend

Try this for the regular expression in seckeepevent

REGEX = (sshd\[\d*\]:|su:|sudo:|failed:)

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...