Getting Data In

Critical Bucket size and range

jamie1
Communicator

Hi There,

I have noticed that the cloud monitoring console is reporting a critical bucket. I only have one and have attached a screenshot. The small % is 100. 

Unfortunately, I am not certain as to what this really means and whether it is something to worry about or not.

Any help would be appreciated,

Jamie

Labels (2)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

This is an indication of inefficient bucket use, meaning buckets roll `before they fill up.  This can happen when indexers restart often, but in this case I suspect it's just a matter of the main index getting very few events before maxHotSpecSecs is reached and the bucket rolls to warm.

The answer for buckets that are known to contain few events is to set maxDataSize to a value that makes the bucket at least 50% full before it rolls.  The default bucket size is 750MB.  The dbinspect command can tell you the current size of buckets to give you an idea of how to set maxDataSize.

Best Practice is to not use the main index at all.  All incoming data should go into a custom index, leaving main empty (and not needing to roll).

---
If this reply helps you, Karma would be appreciated.
0 Karma

isoutamo
SplunkTrust
SplunkTrust
Another reason could be that your events contains timestamps from very far away each other. This also leads that buckets will close earlier than those are full.

There should be some indications for reason in _internal logs or even some CMC -> Indexing -> Data quality.
0 Karma

colbym
Path Finder

I have the same question

0 Karma
Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Your Voice Matters! Help Us Shape the New Splunk Lantern Experience

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Building Momentum: Splunk Developer Program at .conf25

At Splunk, developers are at the heart of innovation. That’s why this year at .conf25, we officially launched ...