Getting Data In

ignore data filtring in a heavy forwarder

aalaa
Path Finder

Hello,

How can i ignore forwarding some of data in a heavy forwarding , i need a syntax to do this !

thank you

Tags (1)
0 Karma

vishaltaneja070
Motivator

Hello @aalaa,

That would be easy to do. If you know which source it is then use props and transforms to do it.
Please check the below link:
https://docs.splunk.com/Documentation/Splunk/7.3.0/Forwarding/Routeandfilterdatad

0 Karma

aalaa
Path Finder

i try with this :
In props.conf, set the TRANSFORMS-null attribute:
[source::/var/log/messages]
TRANSFORMS-null= setnull
Create a corresponding stanza in transforms.conf. Set DEST_KEY to "queue" and FORMAT to "nullQueue":
[setnull]
REGEX = [sshd]
DEST_KEY = queue
FORMAT = nullQueue
Restart Splunk Enterprise.

but the envent still exist !

0 Karma

vishaltaneja070
Motivator

Hello @aala

I think the issue is with the regex, it should be like:

[setnull]
REGEX = \[sshd\]
DEST_KEY = queue
FORMAT = nullQueue

Always test the regex first on https://regex101.com/ if the regex is able to match the event then it will work great.

And also no need to restart Splunk again and again for this, you can directly run on any browser:

http://<your-splunkserver>:8000/en-US/debug/refresh
0 Karma

FrankVl
Ultra Champion

In theory his original regex would have matched as well (and many events it shouldn't have). Since it matches any event that has an s, h or d character in it.

A couple of other things to take into account:
- ensure this is on the first HF / Indexer that touches the data
- make sure that transforms stanza is actually unique. "setnull" is quite generic and might conflict with another transforms config you have under that same name
- you say "event still exist": realize that deploying this config will only affect events ingested from now on. So when validating also make very sure you are only looking at events ingested after the change was done.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...