Getting Data In

Remove 1 field from syslog before sending to Splunk Cloud?

JChris_
Path Finder

I have a system X that sends syslog to a Splunk HF which then sends to Splunk Cloud.

The syslog contains the same data in the fields msg and desc, so I'd like to remove the field desc in Splunk HF before sending the syslog. How can I do that?

I thought about using transforms.conf and props.conf (https://docs.splunk.com/Documentation/Splunk/7.0.3/Forwarding/Routeandfilterdatad#Discard_specific_e...), but this is used for dropping the entire log.

Labels (2)
0 Karma
1 Solution

diogofgm
SplunkTrust
SplunkTrust

You can use props and transforms to remove the desc part without dropping the entire log. You need to build a good regex in order to "select" and remove just the bits you want. This is also used in case you need to anonymise any part of your data before indexing it to splunk. In your case instead of replacing said data with "xxxx" you can replace it with nothing.

Check this example:
https://community.splunk.com/t5/Getting-Data-In/Anonymize-Data-in-Splunk-Search/m-p/238539

 

------------
Hope I was able to help you. If so, some karma would be appreciated.

View solution in original post

0 Karma

diogofgm
SplunkTrust
SplunkTrust

You can use props and transforms to remove the desc part without dropping the entire log. You need to build a good regex in order to "select" and remove just the bits you want. This is also used in case you need to anonymise any part of your data before indexing it to splunk. In your case instead of replacing said data with "xxxx" you can replace it with nothing.

Check this example:
https://community.splunk.com/t5/Getting-Data-In/Anonymize-Data-in-Splunk-Search/m-p/238539

 

------------
Hope I was able to help you. If so, some karma would be appreciated.
0 Karma

JChris_
Path Finder

Thanks, that's exactly what I end up doing after I posted this thread xD

0 Karma
Get Updates on the Splunk Community!

Streamline Data Ingestion With Deployment Server Essentials

REGISTER NOW!Every day the list of sources Admins are responsible for gets bigger and bigger, often making the ...

Remediate Threats Faster and Simplify Investigations With Splunk Enterprise Security ...

REGISTER NOW!Join us for a Tech Talk around our latest release of Splunk Enterprise Security 7.2! We’ll walk ...

Introduction to Splunk AI

WATCH NOWHow are you using AI in Splunk? Whether you see AI as a threat or opportunity, AI is here to stay. ...