topic Re: How to use separate path for Hot, Warm, Cold buckets ? in Getting Data In

How to use separate path for Hot, Warm, Cold buckets ?

ntttechops — Tue, 29 Sep 2020 22:12:20 GMT

We would like to take a back from our buckets.
The backups fails because of high movement of data in HOT Buckets.
We would like to have a separate path for each of the DBs, i.e. something like below setup.

hotPath = $SPLUNK_DB/defaultdb/hotdb
warmPath = $SPLUNK_DB/defaultdb/warmdb
coldPath = $SPLUNK_DB/defaultdb/colddb
thawedPath = $SPLUNK_DB/defaultdb/thaweddb

Please tell us how is the correct way of doing that and support us.
Thank you,

Re: How to use separate path for Hot, Warm, Cold buckets ?

joebisesi — Tue, 29 Sep 2020 22:12:29 GMT

Your indexes.conf should look similar to this for each db:
This is a global setting:
[volume:'volume_name']
path = 'path to storage'
maxVolumeDataSizeMB = 'insert size in MB' <-- I believe this is optional

At the index level:
['index_name']
homePath = volume:'volume_name'/db/db

Configure that for each volume and index/db and you should be good.

Hope this helps

Re: How to use separate path for Hot, Warm, Cold buckets ?

richgalloway — Wed, 28 Nov 2018 16:15:46 GMT

Hot and warm buckets always share the same path. They cannot be separated.

You should have your backup tool ignore hot buckets. Hot buckets have names beginning with "hot_".

Re: How to use separate path for Hot, Warm, Cold buckets ?

ntttechops — Thu, 29 Nov 2018 10:33:12 GMT

That is not what I want,
I want separate path for HOT and WARM DB so that I can exclude the HOT in backups.

Re: How to use separate path for Hot, Warm, Cold buckets ?

joebisesi — Tue, 29 Sep 2020 22:12:45 GMT

As Rich stated, I don't believe the hot and warm buckets can be separated. If you look at the indexes.conf file, they only give you a homePath, coldPath and thawedPath.
Ex
[volume:hot_warm_storage]
path = /dir/splunk/storage/hot_warm_storage
[volume:cold_storage]
path = /dir/splunk/storage/cold_storage

[test_index]
homePath = volume:hot_warm_storage/test_index/db
coldPath = volume:cold_storage/test_index/colddb

Re: How to use separate path for Hot, Warm, Cold buckets ?

ntttechops — Thu, 29 Nov 2018 14:11:51 GMT

Are you sure that is not possible ??

Re: How to use separate path for Hot, Warm, Cold buckets ?

ntttechops — Fri, 30 Nov 2018 10:22:46 GMT

I belive there should be a way to seprate them

Re: How to use separate path for Hot, Warm, Cold buckets ?

richgalloway — Fri, 30 Nov 2018 13:09:29 GMT

Yes, I'm sure.

Re: How to use separate path for Hot, Warm, Cold buckets ?

whrg — Fri, 30 Nov 2018 13:15:57 GMT

This is not possible.
Check out http://docs.splunk.com/Documentation/Splunk/latest/Admin/Indexesconf
You can specify "homePath" (for both the hotdb and the warmdb), but there is neither "hotPath" nor "warmPath".

Re: How to use separate path for Hot, Warm, Cold buckets ?

richgalloway — Tue, 04 Dec 2018 12:41:53 GMT

Contact Splunk support and file an Enhancement Request.