We have a source ABC sending us logs and are being stored inside an index called all_logs. From that source, we want to separate the events, which contains the field SiteUrl: https://www.abc.com/site/PathologyPHI and send these logs to a new index called new_logs, while the rest of the logs should still go to the Index all_logs.
This is what I've tried so far, but all the logs still land up in the Index all_logs, instead of being routed.. FYI, props and transforms are kept under $SPLUNK_HOME/etc/system/local, while the inputs.conf is under the TA, which brings the logs's local directory. Had to do this because in props, there is a setting defined for another sourcetype as well. Any suggestions regarding moving them back to TA as well will be appreciated.
REGEX = SiteUrl:.+PathologyPHI
DEST_KEY = _MetaData:Index
FORMAT = new_logs
Here is the inputs.conf for the source. There are other inputs too, but this inputs comes with the events, which we want to route. We do not want to route all the events coming off this input, only the ones matching the regex:
the regex and your approach seem to be correct.
So please some additional info:
A surely stupid question: did you restarted Heavy Forwarder after update?
Logs are in an Universal Forwarder (read by the inputs.conf in the TA) and they are sent to the HF (where there are props.conf and transforms.conf) and then sent to Indexers, is it correct or there's anything else?
I don't understand what you say: "...setting defined for another sourcetype...".