topic Re: Replication Factor for different buckets in Splunk Enterprise

Replication Factor for different buckets

wgawhh5hbnht — Mon, 14 Jun 2021 19:06:11 GMT

There isn't a way to set RF for different buckets, right? e.g. hot RF 2, cold no RF

We're using smartstore, therefor S3 is handling cold bucket replication and it would drastically reduce the storage cost if we could only have RF for hot buckets.

I've see this post, but it's been a few years.

Re: Replication Factor for different buckets

gjanders — Wed, 16 Jun 2021 05:11:28 GMT

The search replication factor and replication factor only relate to hot buckets when using smartstore. Only 1 copy of a bucket is uploaded to the object storage

Re: Replication Factor for different buckets

wgawhh5hbnht — Wed, 16 Jun 2021 13:02:11 GMT

You're correct @gjanders , the empty directories got me. Thank you for your help. Those looking for the doc: https://docs.splunk.com/Documentation/Splunk/8.2.0/Indexer/IndexerclusteroperationsandSmartStore

For example, if the cluster has a replication factor of 3, three peer nodes continue to maintain metadata information, along with populated or empty directories, for each bucket.
By maintaining metadata for each bucket on the replication factor number of peer nodes, the cluster simplifies the process of fetching the bucket when it is needed, in the case of any interim peer node failure.