Monitoring Splunk

Migrating colddb buckets to new storage.

mgherman
Explorer

Hi,

In an attempt to increase the available storage for indexes, I am looking at moving the colddb indexes to an additional volume/LUN. I am looking at performing the following steps.

  1. Suspend backups
  2. Copy indexes from $SPLUNK_DB/$INDEX_NAME/colddb to $NEW_VOL/splunk/var/lib/splunk/$INDEX_NAME/colddb
  3. Create $SPLUNK_HOME/etc/system/local/index.conf with an updated coldPath to match the above new directory.
  4. Restart Splunk.
  5. Delete buckets in the old coldPath location.

Is this the correct order, or should steps 2 & 3 be reversed?

Thanks,

Michael Herman

Tags (2)
1 Solution

dwaddle
SplunkTrust
SplunkTrust

The absolute safest approach would be to have splunkd down entirely for the duration of your move. That would avoid the potential of new cold buckets being created during your change.

If you just can't do that, your procedure above would probably be fine, as long as you look out for new cold buckets being created. The order you do steps 2 & 3 in doesn't specifically matter unless you include a restart in there.

But, again, I would probably take the safe road and do it all with Splunk down.

View solution in original post

dwaddle
SplunkTrust
SplunkTrust

The absolute safest approach would be to have splunkd down entirely for the duration of your move. That would avoid the potential of new cold buckets being created during your change.

If you just can't do that, your procedure above would probably be fine, as long as you look out for new cold buckets being created. The order you do steps 2 & 3 in doesn't specifically matter unless you include a restart in there.

But, again, I would probably take the safe road and do it all with Splunk down.

mgherman
Explorer

It appears to have worked fine, and subsequent bucket rolls have dropped them into the correct directory. Thanks for the response.

0 Karma
Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...