Getting Data In

Filter data by condition on a heavy forwarder

aalaa
Path Finder

Hello ,

Please i need to filter data on the heavy forwrader to eliminate some logs ,
Exemple : i need to ingnore logs which contains the fields TYPE=PERMIT with the PROTOCOL=HTTP
it's work good to eliminate the log which contains the TYPE=PERMIT but i need to ignore just the TYPE=PERMIT with the PROTOCOL=HTTPS

transforms.conf

[setnull]
REGEX = >PERMIT<
DEST_KEY = queue
FORMAT = nullQueue

0 Karma

somesoni2
Revered Legend

Your REGEX should search for both fields, so it necessary to know in which order they appear in your raw data and if your data is multiline. If it's single line and TYPE=PERMIT comes before PROTOCOL=HTTPS, then you could do REGEX = \>PERMIT\<.+\>HTTPS\< but again, more accurate answers can be given if you share some sample data.

0 Karma

harsmarvania57
Ultra Champion

Can you please post some sample events (Mask sensitive data) ?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

What’s New in Splunk AI: Volume 02

Welcome to the second edition of “What’s New in Splunk AI” where we look at the latest and greatest updates, ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...