Getting Data In
Highlighted

How to load data into multiple indexes based on the event data?

New Member

Can I dynamically assign index value at the indexer level to the events based on the data and load the data into the right index?
For example:
1,A,200
2,A,300
3,B,200
4,B,300
5,C,500
6,C,300

I have created three indexes indexA, indexB, indexC
I want to load the data into indexA,indexB,indexC based on the second column.

After data is loaded:
in IndexA I should have
1,A,200
2,A,300

in indexB I should have
3,B,200
4,B,300

in indexC I should have
5,C,500
6,C,300

0 Karma
Highlighted

Re: How to load data into multiple indexes based on the event data?

Path Finder

You may do this by using props.conf and transforms.conf.

-----------------props.conf---------------------

[indexA]
TRANSFORMS-filter
Aevents= filterA_events

[indexB]
TRANSFORMS-filter
Bevents= filterB_events

[index_C]

TRANSFORMS-filterCevents= filterCevents

----------Transforms.conf--------------------------

[filterAevents]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filterBevents]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filterCevents]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue


If you are using HF to forward events, place these .conf files on HF.
If you are using UF for forward events, place these .conf files on Indexer

Hope this helps ...!!!

0 Karma