Getting Data In

How do I exclude certain emails from being indexed?

capilarity
Path Finder

We have recently turned on journaling within MS Exchange which basically sends a copy of every item to a journaling mail box. We know the email address the process uses and this appears in the message tracking logs as additional emails - in short journaling has doubled our Splunk licence usage!!

We would like to exclude the journaling email address from being indexed.
Exchange can't turn off message tracking for certain email addresses

We are using UF on the Exchange servers with a load balanced intermediate level of Heavy forwarders.

We have tried to apply the exclusion based on this answer - Answer 289736 - how to exclude a sourcetype from being indexed, but using a regex that picks up the journaling email address.

The address we want to exclude is: journal@ev.local

We've tried it on the Intermediate Heavy forwarders and on the index servers with no effect.

The config we have applied is:

props.conf
[MSExchange:2013:MessageTracking]
TRANSFORMS-JournalRemoval = JournalRemoval

transforms.conf
[JournalRemoval]
REGEX =.*journal@ev.*
DEST_KEY = queue
FORMAT = nullqueue

Any ideas why this might not be working?
Thanks

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @capilarity,
filter must be on Indexers if there isn't any Heavy Forwarders, otherwise on HFs.
the instruction to filter data are at https://docs.splunk.com/Documentation/Splunk/8.0.3/Forwarding/Routeandfilterdatad#Discard_specific_e...

Anyway, in transforms.conf try one or the other of these regexes:

REGEX=journal@ev
REGEX=(journal@ev)

Ciao.
Giuseppe

0 Karma

capilarity
Path Finder

Thanks Giuseppe, I had found the docs you highlighted but they are about including the ones that match the regex and discard the rest, we are trying to do the other way round, discard those that match, index the rest.

I've also tried the different combinations of the regex you suggested on both the intermediate HF and the indexer.
Sill no luck 😞

0 Karma

gcusello
SplunkTrust
SplunkTrust
0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...