Splunk Enterprise

rebuilding metrics bucket

Jakfarh
Loves-to-Learn

Trying to fix a corruption issue with a _metrics bucket, using the "./splunk rebuild <path> command.
Doing this, i recieve the following WARN "Fsck - Rebuilding entire bucket is not supported for "metric" bucket that has a "stubbed-out" rawdata journal. Only bloomfilter will be build"

How would i rebuild the metrics bucket to fix the error?

0 Karma

tscroggins
Influencer

Hi @Jakfarh,

How did you identify the corruption?

The rebuild command regenerates tsidx and metadata files from a valid rawdata directory.

By default, metrics indexes have metric.stubOutRawdataJournal = true, and the rawdata journal is truncated when the bucket rolls from hot to warm.

The documentation stresses this point:

Caution: Because setting this attribute to "true" eliminates the data in the rawdata files, those
files can no longer be used in bucket repair operations.

After this occurs, the metrics index bucket is comprised of only the tsidx and metadata files, the loss of which should be mitigated by an appropriate clustering configuration (which disables metric.stubOutRawdataJournal) or a backup solution.

If the tsidx or metadata files are corrupt, you'll need to either address the corruption at the file system or disk level or restore a copy from a backup.

0 Karma
Get Updates on the Splunk Community!

AppDynamics Summer Webinars

This summer, our mighty AppDynamics team is cooking up some delicious content on YouTube Live to satiate your ...

SOCin’ it to you at Splunk University

Splunk University is expanding its instructor-led learning portfolio with dedicated Security tracks at .conf25 ...

Credit Card Data Protection & PCI Compliance with Splunk Edge Processor

Organizations handling credit card transactions know that PCI DSS compliance is both critical and complex. The ...