Monitoring Splunk

Migrating colddb buckets to new storage.

mgherman
Explorer

Hi,

In an attempt to increase the available storage for indexes, I am looking at moving the colddb indexes to an additional volume/LUN. I am looking at performing the following steps.

  1. Suspend backups
  2. Copy indexes from $SPLUNK_DB/$INDEX_NAME/colddb to $NEW_VOL/splunk/var/lib/splunk/$INDEX_NAME/colddb
  3. Create $SPLUNK_HOME/etc/system/local/index.conf with an updated coldPath to match the above new directory.
  4. Restart Splunk.
  5. Delete buckets in the old coldPath location.

Is this the correct order, or should steps 2 & 3 be reversed?

Thanks,

Michael Herman

Tags (2)
1 Solution

dwaddle
SplunkTrust
SplunkTrust

The absolute safest approach would be to have splunkd down entirely for the duration of your move. That would avoid the potential of new cold buckets being created during your change.

If you just can't do that, your procedure above would probably be fine, as long as you look out for new cold buckets being created. The order you do steps 2 & 3 in doesn't specifically matter unless you include a restart in there.

But, again, I would probably take the safe road and do it all with Splunk down.

View solution in original post

dwaddle
SplunkTrust
SplunkTrust

The absolute safest approach would be to have splunkd down entirely for the duration of your move. That would avoid the potential of new cold buckets being created during your change.

If you just can't do that, your procedure above would probably be fine, as long as you look out for new cold buckets being created. The order you do steps 2 & 3 in doesn't specifically matter unless you include a restart in there.

But, again, I would probably take the safe road and do it all with Splunk down.

mgherman
Explorer

It appears to have worked fine, and subsequent bucket rolls have dropped them into the correct directory. Thanks for the response.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...