topic Re: Why are events not routing to specific index based on host? in Getting Data In

Why are events not routing to specific index based on host?

zayers2 — Fri, 20 Jul 2018 14:39:57 GMT

We have radius servers that need to be routed to a specific index. I have written the props.conf and transforms.conf Stanzas and I cannot get them to work. Our indexers are clustered and I made the changes to the .conf files on the cluster master in the directory:

$SPLUNK_HOME\etc\master-apps\_cluster\local\

props.conf

[host::coradius.*]
TRANSFORMS-index = coradius_index_transform

transforms.conf

[coradius_index_transform]
SOURCE_KEY = _MetaData:Host
REGEX = ^host::(coradius.*)$
DEST_KEY = _MetaData:Index
FORMAT = radius

Even after making those changes there are no events in the index. I need some help figuring out why the events from the specific hosts aren't routing to the correct index.

Re: Why are events not routing to specific index based on host?

somesoni2 — Fri, 20 Jul 2018 17:47:23 GMT

Your transforms.conf stanza should be like this

[coradius_index_transform]
 SOURCE_KEY = MetaData:Host
 REGEX = ^coradius.*$
 DEST_KEY = _MetaData:Index
 FORMAT = radius

Re: Why are events not routing to specific index based on host?

zayers2 — Mon, 23 Jul 2018 17:04:19 GMT

I tried that, and it unfortunately didn't work. I modified the transforms.conf in the cluster master's directory: $SPLUNK_HOME\etc\master-apps_cluster\local\

and pushed the configuration to the two indexers, i checked and made sure the config files were there. I cannot figure out why it isn't working.

Re: Why are events not routing to specific index based on host?

somesoni2 — Mon, 23 Jul 2018 17:38:51 GMT

What kind of forwarders do you have in your environment? This settings needs to be applied to place/instance where data parsing happens, so if you're using heavy forwarder (Splunk Enterprise instance as forwarder) OR heavy Intermediate Forwarder (Splunk Enterprise instance which receives data from Universal Forwarder and send it to Indexers), then this should be applied there.

Re: Why are events not routing to specific index based on host?

zayers2 — Mon, 23 Jul 2018 18:09:50 GMT

We are using the Universal Forwarder on our servers and sending them to an indexer. The indexer is where the data parsing takers place.

Re: Why are events not routing to specific index based on host?

somesoni2 — Mon, 23 Jul 2018 18:22:34 GMT

Since your transforms is applied to specified hosts already, give this a try.
props.conf

[host::coradius*]
 TRANSFORMS-index = coradius_index_transform

transforms.conf

 [coradius_index_transform]
 REGEX = .
 DEST_KEY = _MetaData:Index
 FORMAT = radius

Re: Why are events not routing to specific index based on host?

zayers2 — Mon, 23 Jul 2018 18:58:33 GMT

That solved it! Thank you very much for your input.