Knowledge Management

Advantages of rolling over warm bucket to cold bucket.

sreerajms
Explorer

If all the hot, warm and cold buckets are in the same disk partition, then is there any advantage in rolling over indexed data in older warm buckets to cold bucket?

0 Karma

splunker12er
Motivator

same disk partition there is no advantage in rolling over indexed data in older warm buckets to cold bucket

considerations for different storage paths
1. cost 2. performance

Splunk search gives you the results in reverse chronological order-- mostly we are interested to search recent data/logs, than historical and by default Splunk first looks in the hot bucket, then the warm buckets, then cold. The frozen db is never searched.

A recommended setup is to define hot and warm on your local high speed read+write raid1+0 disks,
to define coldPath on the slower disks with a good read speed (RAID5) or remote volumes,

Be aware that the performances of Splunk will depend on the performance of the storage:

indexing performance: linked to the write speed on the homePath location
search performance: linked to the read speed on the homePath and coldPath location.

For example: doing searches over long periods, using old data stored on remote volumes will be slower than doing a specific search on recent events on the local high speed volumes.

Get Updates on the Splunk Community!

How I Instrumented a Rust Application Without Knowing Rust

As a technical writer, I often have to edit or create code snippets for Splunk's distributions of ...

Splunk Community Platform Survey

Hey Splunk Community, Starting today, the community platform may prompt you to participate in a survey. The ...

Observability Highlights | November 2022 Newsletter

 November 2022Observability CloudEnd Of Support Extension for SignalFx Smart AgentSplunk is extending the End ...