topic What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive? in Getting Data In

What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Shuhei052492 — Tue, 22 Jan 2019 07:02:12 GMT

What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Hello, Splunk Professionals,

I am planning to change the path of my index(name is "abc") DB to another drive, because the amount of volums is going to be full.

My envirnment is All-in-on on Windows server and v7.x . And I see these doc to build a plan.
https://docs.splunk.com/Documentation/Splunk/7.2.3/Indexer/Moveanindex

But I am concerned the following thing.
Does anyone have an advice or knowledge related with them?
I really appreciate any comments.

Is it enough to let splunkd be stop to prepare moving index DB? I am wondering whether it is necessarry for splunkd to be restart before being stop or not, because hot bucket must migrate to warm bucket before moving.

2.Is it possible to search the hot bucket after migrating the folder which is included with hot, warm, cold?

Best regards,

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

dkeck — Tue, 22 Jan 2019 07:20:28 GMT

HI just to clarify, you want to move all of your indexes to a new disk? or just one?. The doc you linked is for moving the whole SPLUNK_DB

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

teunlaan — Tue, 22 Jan 2019 07:25:52 GMT

If you only want to move 1 off "many" indexes , Don't edit splunk-launch.conf. You need to edit the location for that index in indexes.conf.

Yes stop splunk, move the index, edit the conf files, start splunk > you can search all your data as before

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

woodcock — Tue, 22 Jan 2019 15:49:52 GMT

Do rsync while splunk is running.
Do rsync again while splunk is running.
Stop splunk.
Do rsynch again.
Edit the inputs.conf to point to new location.
Start splunk.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Shuhei052492 — Wed, 23 Jan 2019 01:34:18 GMT

Hi,
Thank you for your message.
I would like to migrate just one index to another drive.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Shuhei052492 — Wed, 23 Jan 2019 02:00:26 GMT

Hi teunlaan,

Thanks for your advice.
Is it not necessary to run the following command to migrate hot buckets when splunk stop
command:
splunk _internal call /data/indexes//roll-hot-buckets –auth :

https://docs.splunk.com/Documentation/Splunk/7.2.3/Indexer/Backupindexeddata

Because I think it is not safe to migrate hot bucket.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

woodcock — Wed, 23 Jan 2019 02:21:46 GMT

When you stop splunk, all hot buckets close and roll to warm. You have to stop splunk to change the indexes.conf setting anyway. There is no need for such gymnastics.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Shuhei052492 — Wed, 23 Jan 2019 02:35:57 GMT

Hi woodcock,
As my verification, there are hot bucket when stopping splunk.
And then after running splunk service, hot buckets migrated to warm bucket.

So I am confused about why hot bucket does not migrate to warm bucket when stopping splunk.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

woodcock — Wed, 23 Jan 2019 02:49:51 GMT

You are confused about hot and warm. A hot bucket is a warm bucket that is open for writing new data; a warm bucket is a hot bucket that has been closed and is no longer being used to write new data. They are the same physical thing in the same physical space. The only difference is whether Splunk is writing to it. Once closed, a hot/warm bucket will never be opened for writing again (it has become a warm bucket). So, by definition, stopping Splunk rolls all hot buckets to a warm state, but in the same physical space with the same name and directory structure. You are overthinking and over-complicating this.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

Shuhei052492 — Wed, 23 Jan 2019 05:40:01 GMT

I really understood about the hot and buckets.
I appreciate your following kind answer.

You are confused about hot and warm. A hot bucket is a warm bucket that is open for writing new data; a warm bucket is a hot bucket that has been closed and is no longer being used to write new data. They are the same physical thing in the same physical space. The only difference is whether Splunk is writing to it. Once closed, a hot/warm bucket will never be opened for writing again (it has become a warm bucket). So, by definition, stopping Splunk rolls all hot buckets to a warm state, but in the same physical space with the same name and directory structure. You are overthinking and over-complicating this.

I hope the doc of splunk will be added such a kind description.

Re: What is the best way to deal with my buckets when migrating the Splunk_DB of a index to another drive?

richgalloway — Wed, 23 Jan 2019 13:51:08 GMT

If you submit this as feedback to the appropriate doc page, it will probably be added in some form.