Knowledge Management

Advantages of rolling over warm bucket to cold bucket.


If all the hot, warm and cold buckets are in the same disk partition, then is there any advantage in rolling over indexed data in older warm buckets to cold bucket?

0 Karma


same disk partition there is no advantage in rolling over indexed data in older warm buckets to cold bucket

considerations for different storage paths
1. cost 2. performance

Splunk search gives you the results in reverse chronological order-- mostly we are interested to search recent data/logs, than historical and by default Splunk first looks in the hot bucket, then the warm buckets, then cold. The frozen db is never searched.

A recommended setup is to define hot and warm on your local high speed read+write raid1+0 disks,
to define coldPath on the slower disks with a good read speed (RAID5) or remote volumes,

Be aware that the performances of Splunk will depend on the performance of the storage:

indexing performance: linked to the write speed on the homePath location
search performance: linked to the read speed on the homePath and coldPath location.

For example: doing searches over long periods, using old data stored on remote volumes will be slower than doing a specific search on recent events on the local high speed volumes.

Get Updates on the Splunk Community!

Splunk APM & RUM | Upcoming Planned Maintenance

There will be planned maintenance of the streaming infrastructure for Splunk APM and Splunk RUM in the coming ...

Part 2: Diving Deeper With AIOps

Getting the Most Out of Event Correlation and Alert Storm Detection in Splunk IT Service Intelligence   Watch ...

User Groups | Upcoming Events!

If by chance you weren't already aware, the Splunk Community is host to numerous User Groups, organized ...