Knowledge Management

SmartStore - The home path and cold path of each index must point to the same partition.

patng_nw
Communicator

In https://docs.splunk.com/Documentation/Splunk/8.0.7/Indexer/AboutSmartStore, there is a statement saying that "The home path and cold path of each index must point to the same partition."

I am considering migrating some of the indexes in my clustered indexers to SmartStore.  However, most of my indexes have their home path on an SSD partition, with the cold path on a HDD partition.   With the statement above, does it mean that I cannot migrate them to SmartStore?

Labels (1)
0 Karma
1 Solution

scelikok
SplunkTrust
SplunkTrust

This is for new index definitions. SmartStore depends on CacheManager to download required data from S3 to local fast storage which is hot. Since there is no warm or cold anymore, all data should be on the fastest local disk for performance. 

On migration cases, since it is not easy to make hot  and cold path the same, system supports cold data migration by keeping the path information.

I hope this helps, of course you should test the migration on test system before production.

If this reply helps you an upvote and "Accept as Solution" is appreciated.

View solution in original post

patng_nw
Communicator

@scelikok 

Thanks a lot.  It makes sense.  But then what does the statement "The home path and cold path of each index must point to the same partition." in the doc really mean?

0 Karma

scelikok
SplunkTrust
SplunkTrust

This is for new index definitions. SmartStore depends on CacheManager to download required data from S3 to local fast storage which is hot. Since there is no warm or cold anymore, all data should be on the fastest local disk for performance. 

On migration cases, since it is not easy to make hot  and cold path the same, system supports cold data migration by keeping the path information.

I hope this helps, of course you should test the migration on test system before production.

If this reply helps you an upvote and "Accept as Solution" is appreciated.

patng_nw
Communicator

That's very clear now.  Thanks a lot!

0 Karma

scelikok
SplunkTrust
SplunkTrust

I appreciate if you can upvode.

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

scelikok
SplunkTrust
SplunkTrust

@patng_nw, you can migrate them. Migration will move all warm and cold data to SmartStore. Only difference cold data will be fetched to cold path location. 

You can see below from documentation;

https://docs.splunk.com/Documentation/Splunk/8.0.7/Indexer/MigratetoSmartStore 
In all respects, cold buckets are functionally equivalent to warm buckets. The cache manager manages the migrated cold buckets in the same way that it manages warm buckets. The only difference is that the cold buckets will be fetched into the cold path location, rather than the home path location.

 

If this reply helps you an upvote and "Accept as Solution" is appreciated.
Get Updates on the Splunk Community!

Earn a $35 Gift Card for Answering our Splunk Admins & App Developer Survey

Survey for Splunk Admins and App Developers is open now! | Earn a $35 gift card!      Hello there,  Splunk ...

Continuing Innovation & New Integrations Unlock Full Stack Observability For Your ...

You’ve probably heard the latest about AppDynamics joining the Splunk Observability portfolio, deepening our ...

Monitoring Amazon Elastic Kubernetes Service (EKS)

As we’ve seen, integrating Kubernetes environments with Splunk Observability Cloud is a quick and easy way to ...