Knowledge Management

[Smartstore] CacheManager and eviction

rbal_splunk
Splunk Employee
Splunk Employee

Could you please help understand the DEBUG option for CacheManager to instigate eviction?

 

 

Labels (1)
0 Karma

rbal_splunk
Splunk Employee
Splunk Employee

Cache manager evict buckets when

(i) the total disk utilized by WARM and Cold Buckets  exceeds  max_cache_size

or

(ii)The current free space for partition falls below eviction_padding+minFreeSpace

max_cache_size Specifies the maximum space, in megabytes, per partition, that the cache can occupy on disk. If this value is exceeded, the cache manager starts evicting buckets.

If max_cache_size=0  it means this feature is not used, and has no maximum size, in this case, the eviction will happen when the $SPLUNK_DB partition's free space drops below eviction_padding+minFreeSpace.

The total cache usage is calculated by the Cache manager as the sum of all NONE hot buckets size.

When $SPLUNK_HOME and $SPLUNK_DB are on different partitions, assuming all of the caches in $SPLUNK_DB  will account for disk spaces in that partitions only.

DEBUG on CacheManager shows entries stats for cache manager

07-08-2020 19:19:58.806 +0000 DEBUG CacheManager - The system has freebytes=944143511552 with minfreebytes=471859200000 cachereserve=471859208192 totalpadding=943718408192 buckets_size=0 maxSize=0

07-08-2020 19:19:58.887 +0000 DEBUG CacheManager - The system has freebytes=944141152256 with minfreebytes=471859200000 cachereserve=471859208192 totalpadding=943718408192 buckets_size=0 maxSize=0

Where

  •  Freebytes>> freeBytes
  •  Minfreebytes >>minFreeBytes
  •  Cachereserve >> evictionReservedBytes
  •  Totalpadding >> minFreeBytes + evictionReservedBytes
  •   buckets_size >> max_cache_size

  cmsize.png

 

 

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

From Data to Insight: Announcing the Winners of the Splunk Dashboard Contest

Hi Splunkers, First off, thank you to everyone who participated in our very first From Data to Insight: The ...

Splunk Developers: Construct Your Future at the .conf26 Builder Bar

Calling all Splunk architects, platform admins, and app developers: the site is open, and the blueprints are ...

Quick connection discovery mode for forwarders

When a Splunk forwarder loses connectivity to its indexers, it does not always reconnect immediately. In many ...