Deployment Architecture

Copy index

splunkuzleuven
Loves-to-Learn Lots

I'm looking for a clean way to copy an index or duplicate a data stream withouth having to index it twice.

We have a Splunk production environment, but are setting up a new environment. This one is more development based, but would use some of the data that is running in production.
Seeing we don't want to mix dev and prod, but don't want to index data twice, what would be the best way to make certain data or indexes available to both machines?

We tried a setup with forwarding from the prod machine, and with transform and props we managed to get the correct data to our dev machine, but then the prod machine stopped indexing all together...

Tags (1)
0 Karma

skalliger
Motivator

First of all a question: Do you really need to copy your indexes to new indexers? If so, do you really think you need new indexers? You could just setup a new search head which points to your existing indexers and do your development from there.

Skalli

0 Karma

splunkuzleuven
Loves-to-Learn Lots

Lets say, not copy the index directly. Just copy the stream of data, but withouth it being indexed twice (don't want to waste volume).
How would I go about doing that withouth having to setup a new server if possible...

I'm open to all suggestions, as long as I'm not wasting license volume.

0 Karma

lakshman239
Influencer

If you want your prod data to be useful/available for dev, without indexing, you only need to setup a search head for dev and point to existing indexers.

Alternatively, on your laptop/dev machine, you can have splunk and eventgen app and config [ taking samples from prod] and do your development.

In both cases, you will need some compute and license/free, but an option.

0 Karma
Get Updates on the Splunk Community!

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...