Getting Data In

How to load data into multiple indexes based on the event data?

khreddy777
New Member

Can I dynamically assign index value at the indexer level to the events based on the data and load the data into the right index?
For example:
1,A,200
2,A,300
3,B,200
4,B,300
5,C,500
6,C,300

I have created three indexes indexA, indexB, indexC
I want to load the data into indexA,indexB,indexC based on the second column.

After data is loaded:
in IndexA I should have
1,A,200
2,A,300

in indexB I should have
3,B,200
4,B,300

in indexC I should have
5,C,500
6,C,300

0 Karma

neelshah
Path Finder

You may do this by using props.conf and transforms.conf.

-----------------props.conf---------------------

[index_A]
TRANSFORMS-filter_A_events= filter_A_events

[index_B]
TRANSFORMS-filter_B_events= filter_B_events

[index_C]

TRANSFORMS-filter_C_events= filter_C_events

----------Transforms.conf--------------------------

[filter_A_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filter_B_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue

[filter_C_events]
REGEX =
DEST_KEY = queue
FORMAT = indexQueue


If you are using HF to forward events, place these .conf files on HF.
If you are using UF for forward events, place these .conf files on Indexer

Hope this helps ...!!!

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Deep insights, no barriers: Splunk Observability Cloud Free Edition

As software delivery cycles continue to accelerate, observability shouldn’t be a luxury — it should be a ...

Monitoring AI Agents with Splunk Observability Cloud

Let’s say I’m running a travel planning AI app in production. A user asks for three concise hotel options in ...

[Puzzles] Solve, Learn, Repeat: Tiling

This puzzle (first published here) is based on finding groups of tessellated tiles (inspired by floor tiles I ...