Getting Data In

ignore data filtring in a heavy forwarder

aalaa
Path Finder

Hello,

How can i ignore forwarding some of data in a heavy forwarding , i need a syntax to do this !

thank you

Tags (1)
0 Karma

vishaltaneja070
Motivator

Hello @aalaa,

That would be easy to do. If you know which source it is then use props and transforms to do it.
Please check the below link:
https://docs.splunk.com/Documentation/Splunk/7.3.0/Forwarding/Routeandfilterdatad

0 Karma

aalaa
Path Finder

i try with this :
In props.conf, set the TRANSFORMS-null attribute:
[source::/var/log/messages]
TRANSFORMS-null= setnull
Create a corresponding stanza in transforms.conf. Set DEST_KEY to "queue" and FORMAT to "nullQueue":
[setnull]
REGEX = [sshd]
DEST_KEY = queue
FORMAT = nullQueue
Restart Splunk Enterprise.

but the envent still exist !

0 Karma

vishaltaneja070
Motivator

Hello @aala

I think the issue is with the regex, it should be like:

[setnull]
REGEX = \[sshd\]
DEST_KEY = queue
FORMAT = nullQueue

Always test the regex first on https://regex101.com/ if the regex is able to match the event then it will work great.

And also no need to restart Splunk again and again for this, you can directly run on any browser:

http://<your-splunkserver>:8000/en-US/debug/refresh
0 Karma

FrankVl
Ultra Champion

In theory his original regex would have matched as well (and many events it shouldn't have). Since it matches any event that has an s, h or d character in it.

A couple of other things to take into account:
- ensure this is on the first HF / Indexer that touches the data
- make sure that transforms stanza is actually unique. "setnull" is quite generic and might conflict with another transforms config you have under that same name
- you say "event still exist": realize that deploying this config will only affect events ingested from now on. So when validating also make very sure you are only looking at events ingested after the change was done.

0 Karma
Get Updates on the Splunk Community!

Splunk + ThousandEyes: Correlate frontend, app, and network data to troubleshoot ...

 Are you tired of troubleshooting delays caused by siloed frontend, application, and network data? We've got a ...

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI!Discover how Splunk’s agentic AI ...

🔐 Trust at Every Hop: How mTLS in Splunk Enterprise 10.0 Makes Security Simpler

From Idea to Implementation: Why Splunk Built mTLS into Splunk Enterprise 10.0  mTLS wasn’t just a checkbox ...