Knowledge Management

SmartStore - The home path and cold path of each index must point to the same partition.

patng_nw
Communicator

In https://docs.splunk.com/Documentation/Splunk/8.0.7/Indexer/AboutSmartStore, there is a statement saying that "The home path and cold path of each index must point to the same partition."

I am considering migrating some of the indexes in my clustered indexers to SmartStore.  However, most of my indexes have their home path on an SSD partition, with the cold path on a HDD partition.   With the statement above, does it mean that I cannot migrate them to SmartStore?

Labels (1)
0 Karma
1 Solution

scelikok
SplunkTrust
SplunkTrust

This is for new index definitions. SmartStore depends on CacheManager to download required data from S3 to local fast storage which is hot. Since there is no warm or cold anymore, all data should be on the fastest local disk for performance. 

On migration cases, since it is not easy to make hot  and cold path the same, system supports cold data migration by keeping the path information.

I hope this helps, of course you should test the migration on test system before production.

If this reply helps you an upvote is appreciated.

View solution in original post

patng_nw
Communicator

@scelikok 

Thanks a lot.  It makes sense.  But then what does the statement "The home path and cold path of each index must point to the same partition." in the doc really mean?

0 Karma

scelikok
SplunkTrust
SplunkTrust

This is for new index definitions. SmartStore depends on CacheManager to download required data from S3 to local fast storage which is hot. Since there is no warm or cold anymore, all data should be on the fastest local disk for performance. 

On migration cases, since it is not easy to make hot  and cold path the same, system supports cold data migration by keeping the path information.

I hope this helps, of course you should test the migration on test system before production.

If this reply helps you an upvote is appreciated.

patng_nw
Communicator

That's very clear now.  Thanks a lot!

0 Karma

scelikok
SplunkTrust
SplunkTrust

I appreciate if you can upvode.

If this reply helps you an upvote is appreciated.
0 Karma

scelikok
SplunkTrust
SplunkTrust

@patng_nw, you can migrate them. Migration will move all warm and cold data to SmartStore. Only difference cold data will be fetched to cold path location. 

You can see below from documentation;

https://docs.splunk.com/Documentation/Splunk/8.0.7/Indexer/MigratetoSmartStore 
In all respects, cold buckets are functionally equivalent to warm buckets. The cache manager manages the migrated cold buckets in the same way that it manages warm buckets. The only difference is that the cold buckets will be fetched into the cold path location, rather than the home path location.

 

If this reply helps you an upvote is appreciated.
Get Updates on the Splunk Community!

New Splunk Observability innovations: Deeper visibility and smarter alerting to ...

You asked, we delivered. Splunk Observability Cloud has several new innovations giving you deeper visibility ...

Synthetic Monitoring: Not your Grandma’s Polyester! Tech Talk: DevOps Edition

Register today and join TekStream on Tuesday, February 28 at 11am PT/2pm ET for a demonstration of Splunk ...

Instrumenting Java Websocket Messaging

Instrumenting Java Websocket MessagingThis article is a code-based discussion of passing OpenTelemetry trace ...