Getting Data In

How do I exclude certain emails from being indexed?

capilarity
Path Finder

We have recently turned on journaling within MS Exchange which basically sends a copy of every item to a journaling mail box. We know the email address the process uses and this appears in the message tracking logs as additional emails - in short journaling has doubled our Splunk licence usage!!

We would like to exclude the journaling email address from being indexed.
Exchange can't turn off message tracking for certain email addresses

We are using UF on the Exchange servers with a load balanced intermediate level of Heavy forwarders.

We have tried to apply the exclusion based on this answer - Answer 289736 - how to exclude a sourcetype from being indexed, but using a regex that picks up the journaling email address.

The address we want to exclude is: journal@ev.local

We've tried it on the Intermediate Heavy forwarders and on the index servers with no effect.

The config we have applied is:

props.conf
[MSExchange:2013:MessageTracking]
TRANSFORMS-JournalRemoval = JournalRemoval

transforms.conf
[JournalRemoval]
REGEX =.*journal@ev.*
DEST_KEY = queue
FORMAT = nullqueue

Any ideas why this might not be working?
Thanks

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @capilarity,
filter must be on Indexers if there isn't any Heavy Forwarders, otherwise on HFs.
the instruction to filter data are at https://docs.splunk.com/Documentation/Splunk/8.0.3/Forwarding/Routeandfilterdatad#Discard_specific_e...

Anyway, in transforms.conf try one or the other of these regexes:

REGEX=journal@ev
REGEX=(journal@ev)

Ciao.
Giuseppe

0 Karma

capilarity
Path Finder

Thanks Giuseppe, I had found the docs you highlighted but they are about including the ones that match the regex and discard the rest, we are trying to do the other way round, discard those that match, index the rest.

I've also tried the different combinations of the regex you suggested on both the intermediate HF and the indexer.
Sill no luck 😞

0 Karma

gcusello
SplunkTrust
SplunkTrust
0 Karma
Get Updates on the Splunk Community!

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Shape the Future of Splunk: Join the Product Research Lab!

Join the Splunk Product Research Lab and connect with us in the Slack channel #product-research-lab to get ...