Getting Data In

Moving data in indexers (clustered environment) to frozen bucket

cirkit1
Explorer

Have a clustered environment of 3 indexers. Data in the indexers was used to test full architecture capability.

dont need the data anymore in the indexers as would like to start off with clean slate on indexers.

Would like to move existing data to a frozen bucket, as we been told repeatedly it is not a good idea to delete indexer data.

Looking for recommendation on best path and feasibility.

Tags (3)

lguinn2
Legend

You could do it this way:

  1. Make sure that no inputs.conf is sending data to that index. Generally, it is okay to downsize an index while it is still being used, but the settings you will use here are pretty extreme. And you are deleting the index in the last step.
  2. Make sure that you have specified a coldToFrozenDir - it can be anywhere that you like
  3. Set the frozenTimePeriodInSecs to a small value like 86400 (1 day).
  4. Wait until the time period is up.
  5. Use this search | dbinspect index=yourindex span=7d to check that you do not have any buckets with data in them. You should still have hot buckets, but the event count should be zero.
  6. Archive everything in the frozen directory.
  7. Delete the directory containing the index (its location is specified in indexes.conf)
  8. Delete the index stanza from indexes.conf.

    [yourindex]
    ...
    frozenTimePeriodInSecs=86400
    coldToFrozenDir=/tmp/directoryforfrozenbuckets

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Dynamic formatting from XML events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...