topic Re: Determine Index Retention Time in Getting Data In

Determine Index Retention Time

daniel333 — Fri, 25 Oct 2013 00:43:54 GMT

Hello,

We have about 10 indexers setup in our distributed search. Not sure if this matters.

where do I go to determine the rention time on an index? I am trying to ensure we are keeping at least 90 days on a few of them.

Re: Determine Index Retention Time

lukejadamec — Fri, 25 Oct 2013 00:49:39 GMT

You'll want to check the frozenTimePeriodInSecs and maxTotalDataSizeMB attributes in indexes.conf.

frozenTimePeriodInSecs sets the time in seconds for how long the cold buckets will stay around before they are deleted or archived (frozen).

maxTotalDataSizeMB sets the max size of the index before buckets are deleted or archived (frozen).

These can be set as both a global attribute and as a per index attribute. See the documentation for your Splunk version at:
http://docs.splunk.com/Documentation/Splunk/6.0/admin/Indexesconf

Re: Determine Index Retention Time

kristian_kolb — Fri, 25 Oct 2013 06:45:02 GMT

If you have a search head that searches all the indexers, you can run this search, which should give you the information;

| rest /services/admin/indexes | eval yr = floor(frozenTimePeriodInSecs/86400/365)| eval dy = (frozenTimePeriodInSecs/86400) % 365 | eval ret = yr . " years, " . dy . " days" | stats list(splunk_server) list(frozenTimePeriodInSecs) list(ret) by title