Getting Data In

How to configure the retention policy for an index to delete data that is one hour old?

SrinivasaC
Path Finder

Hi,

We have an index, and for every half an hour, it's indexing with 350,000 of events. After every ONE Hour, the previous ONE hour of data is no longer required. So, how can I delete that 1 hour old data from the index, or how can we handle this situation to free up my index memory/ index events after every one hour.

  • What would be the minimum retention period for the Index in Hot/Warm/Cold buckets?
  • What would be the minimum Frozen-period for the index?

Thanks in advance.

0 Karma

Yasaswy
Contributor

Hi,
you can try frozenTimePeriodInSecs, rotatePeriodInSecs options.

Eg:
frozenTimePeriodInSecs=3600
rotatePeriodInSecs=30

Also dpeneding on the data size you are receiving you can try other options

maxTotalDataSizeMB
homePath.maxDataSizeMB
coldPath.maxDataSizeMB

check out the spec for options..

0 Karma
Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Dynamic formatting from XML events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...