Knowledge Management

Advantages of rolling over warm bucket to cold bucket.

sreerajms
Explorer

If all the hot, warm and cold buckets are in the same disk partition, then is there any advantage in rolling over indexed data in older warm buckets to cold bucket?

0 Karma

splunker12er
Motivator

same disk partition there is no advantage in rolling over indexed data in older warm buckets to cold bucket

considerations for different storage paths
1. cost 2. performance

Splunk search gives you the results in reverse chronological order-- mostly we are interested to search recent data/logs, than historical and by default Splunk first looks in the hot bucket, then the warm buckets, then cold. The frozen db is never searched.

A recommended setup is to define hot and warm on your local high speed read+write raid1+0 disks,
to define coldPath on the slower disks with a good read speed (RAID5) or remote volumes,

Be aware that the performances of Splunk will depend on the performance of the storage:

indexing performance: linked to the write speed on the homePath location
search performance: linked to the read speed on the homePath and coldPath location.

For example: doing searches over long periods, using old data stored on remote volumes will be slower than doing a specific search on recent events on the local high speed volumes.

Get Updates on the Splunk Community!

New in Observability - Improvements to Custom Metrics SLOs, Log Observer Connect & ...

The latest enhancements to the Splunk observability portfolio deliver improved SLO management accuracy, better ...

Improve Data Pipelines Using Splunk Data Management

  Register Now   This Tech Talk will explore the pipeline management offerings Edge Processor and Ingest ...

3-2-1 Go! How Fast Can You Debug Microservices with Observability Cloud?

Register Join this Tech Talk to learn how unique features like Service Centric Views, Tag Spotlight, and ...