Getting Data In

Deleting datas on one index after routing them to another index

Nicolas2203
Path Finder

Hello,
My use case :

Context : On azure, datas from several applications are pushed in a Azure EventHub

I need to separate the datas from one application, and put this datas into a new index on Splunk

On Azure, all the resources of this app are in one Ressource Group : TheAppResourceGroupName

I used a Heavy Forwarder, and this are my configs :

props.conf :
[source::eventhub://EVENTHUBAZURE.servicebus.windows.net/app-logs;]
TRANSFORMS-route =  routeToNewIndex, discard_original,

transforms.conf
[routeToNewIndex]
REGEX = TheAppResourceGroupName
DEST_KEY = _MetaData:Index
FORMAT = NewIndex


[discard_original]
REGEX = TheAppResourceGroupName
DEST_KEY = queue
FORMAT = nullQueue

This config will delete the datas, yes, but in the NewIndex, and not in the original Index, after the routing.

I didn't find an answer witch fit with my needs on the commu and the docs, but maybe someone has to face a similar need .

Thanks a lot for the help!

Nico

Labels (1)
0 Karma

Nicolas2203
Path Finder

Hello @livehybrid , yes, data are still getting in the original index and they contain "TheAppResourceGroupName"

 

0 Karma

livehybrid
SplunkTrust
SplunkTrust

Hi @Nicolas2203 

Are you still seeing data containing "TheAppResourceGroupName" in the original index name?

 

0 Karma
Get Updates on the Splunk Community!

Data Management Digest – December 2025

Welcome to the December edition of Data Management Digest! As we continue our journey of data innovation, the ...

Index This | What is broken 80% of the time by February?

December 2025 Edition   Hayyy Splunk Education Enthusiasts and the Eternally Curious!    We’re back with this ...

Unlock Faster Time-to-Value on Edge and Ingest Processor with New SPL2 Pipeline ...

Hello Splunk Community,   We're thrilled to share an exciting update that will help you manage your data more ...