Splunk Search

How to start conditional logging from Universal forwarder on Splunk

ayushchoudhary
Path Finder

I have a server of which logs are indexed on splunk. The server is universal forwarder and sends a log file continuously to the Splunk to index. The logs have a lot of events with "INFO". I require that the events with "INFO" should be discarded and will not indexed by splunk.
To attain the same i had made following changes on Indexer as my forwarder is universal forwarder.

Path: /opt/splunk/etc/apps/search/local/props.conf
[host::abcd.global.trafigura.com]
sourcetype = abcd Log
TRANSFORMS-null= setnull, setparsing

Path: /opt/splunk/etc/apps/search/local/transforms.conf
[setnull]
REGEX = INFO
DEST_KEY = queue
FORMAT = nullQueue

[setparsing]
REGEX = .
DEST_KEY = queue

FORMAT = indexQueue

But i'm not able to discard the events with INFO. Please help.

0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

Remove the setparsing part - that's for the opposite, "remove everything except the regex in the setparsing stanza". In your case, the dot matches everything so it keeps everything.

TRANSFORMS-null = setnull

As a general advice, make sure your regex INFO doesn't accidentally discard events that are of loglevel ERROR but happen to contain INFO somewhere else.

View solution in original post

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

Remove the setparsing part - that's for the opposite, "remove everything except the regex in the setparsing stanza". In your case, the dot matches everything so it keeps everything.

TRANSFORMS-null = setnull

As a general advice, make sure your regex INFO doesn't accidentally discard events that are of loglevel ERROR but happen to contain INFO somewhere else.

0 Karma

somesoni2
Revered Legend

Check if the host name is correct? IMO, the setparsing stanza is not required. Hope you restarted your indexer after making this change.
Also, routing and filtering for structured data happens on UF itseft so can you confirm if your log data is structured or not. (see this http://docs.splunk.com/Documentation/Splunk/latest/Forwarding/Routeandfilterdatad#Caveats_for_routin...)

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Vibe-coding, AI, and Splunkcraft: Highlights from the .conf26 Builder Bar

If you stopped by the Builder Bar at .conf26, thank you! This year, we brought ...

Thanks for the Memories: .conf26 Took Learning to New Heights

Thank you, Splunk Community, for making .conf26 in Denver one for the books. From packed Splunk University ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...