topic Re: Distribute data from one source to different indexes in Getting Data In

Distribute data from one source to different indexes

kenchisho — Mon, 28 Sep 2020 09:44:39 GMT

Hi guys.

I am having some trouble routing data from one source to different indexes.

Here is my setup

inputs.conf

[monitor://C:\Program Files\Splunk\etc\apps\idsplunk\logs\test.log]
disabled = false
followTail = 0
index = main
sourcetype = test

transforms.conf

[reroute_index_1]
REGEX = 192.168.210.10
DEST_KEY = _MetaData:Index
FORMAT = testindex1

[reroute_index_2]
REGEX = 192.168.200.10
DEST_KEY = _MetaData:Index
FORMAT = testindex2

props.conf

[test]
TRANSFORMS-index1=reroute_index_1
TRANSFORMS-index2=reroute_index_2

At the moment I am testing this out so there are only 2 indexes... In production there should be 20+ indexes where all the data is coming in from one source (syslogNG).

With this setup my data does not get indexed at all... what am I missing?

Re: Distribute data from one source to different indexes

sdwilkerson — Tue, 19 Jul 2011 09:04:02 GMT

Do the indexes "testindex1" and "testindex2" exists? Did you create them either through the UI, cli, or by editing indexes.conf?

Re: Distribute data from one source to different indexes

kenchisho — Tue, 19 Jul 2011 10:28:36 GMT

Yes they exist... this is now working... for some reason the config kicked in after i restarted splunk a few times... wierd

Re: Distribute data from one source to different indexes

kenchisho — Tue, 19 Jul 2011 10:29:45 GMT

The setup above works perfectly... It kicked in after splunk was restarted a few times...