topic Re: Relocate KVstore in a cluster in Knowledge Management

Relocate KVstore in a cluster

nawazns5038 — Tue, 22 May 2018 19:11:24 GMT

Hi,

How do we relocate the KVstore on to a new location in a search head cluster.

I heard that there are some settings on the server.conf which would help in relocating the KVstore but what is the safest way to do it in a cluster without causing any KV store errors ??

Thanks

Re: Relocate KVstore in a cluster

p_gurav — Wed, 23 May 2018 04:04:51 GMT

This may help:
https://answers.splunk.com/answers/389298/relocate-kvstore-files-on-filesystem.html

Re: Relocate KVstore in a cluster

nawazns5038 — Wed, 23 May 2018 19:02:53 GMT

yup, but how do you do it in a cluster without any errors ??

Re: Relocate KVstore in a cluster

solarboyz1 — Wed, 23 May 2018 20:37:38 GMT

You will need to do it one member at a time.

Take the member out of the cluster.
shut member down
Follow instructions to move kvstore
Start member
Add member to cluster

Repeat on next cluster member.

Re: Relocate KVstore in a cluster

nawazns5038 — Fri, 08 Jun 2018 00:52:11 GMT

If we do that won't there be any errors if the member joins back with a different KV store location than others ? ?

Re: Relocate KVstore in a cluster

solarboyz1 — Fri, 08 Jun 2018 12:47:43 GMT

I don't believe so, the cluster will not recognize changes made by edits to the ../etc/system/local/server.conf.

If you're concerned...then you could shut the entire cluster down and move the location. Just requires and outage.

Re: Relocate KVstore in a cluster

dchoi_splunk — Wed, 12 Sep 2018 05:43:09 GMT

Tested on SHC which has 3 members:
To change the default kvstore path to a different mount point in SHC, below steps can be doable.

Stop the service on one of search head member(not kvstore primary)
Repoint the kvstore path to a newly created empty directory with write permission (http://docs.splunk.com/Documentation/Splunk/latest/Admin/Serverconf?utm_source=answers&utm_medium=in-answer&utm_term=server.conf&utm_campaign=refdoc#KV_Store_configuration)
Start the service
Check if resync is working.
then repeat 1-4 for the next member

Above steps worked.