Getting Data In

Per index archiving

alexander_lucas
Explorer

If I define this in .../local/indexes.conf


[default]
coldToFrozenDir = $SPLUNK_DB/frozenArchive

Will Splunk roll "frozen" buckets from all indexes inside var/lib/splunk/frozenArchive? If so, can this cause conflicts or is there auto-suffix/prefix for file names? My idea was to have a general coldToFrozenDir rather than per index. This would (in theory) take care of new indexes.

1 Solution

gkanapathy
Splunk Employee
Splunk Employee

I'm not sure this will work as you want, but I believe that if you simply put coldToFrozenDir = $SPLUNK_DB/frozenArchive in the indexes.conf file at the top, not under a stanza header, it will have the effect you're looking for. However, please note that once the buckets are rolled into the directory, there is nothing that will tell you what index it originally came from. They will still work and still be usable, but the index name will be lost.

View solution in original post

alexander_lucas
Explorer

it would still be nice to have a $SPUNK_INDEX variable so that one could add a generic coldToFrozenDir var

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

I'm not sure this will work as you want, but I believe that if you simply put coldToFrozenDir = $SPLUNK_DB/frozenArchive in the indexes.conf file at the top, not under a stanza header, it will have the effect you're looking for. However, please note that once the buckets are rolled into the directory, there is nothing that will tell you what index it originally came from. They will still work and still be usable, but the index name will be lost.

alexander_lucas
Explorer

Perhaps there is a special variable for index names?
e.g.
coldToFrozenDir = $SPLUNK_DB/frozenArchive/$SPLUNK_INDEX
then the structure would be:
.../frozenArchive/main
.../frozenArchive/_audit
...[etc]

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

ATTENTION: We’re Moving! (AGAIN!)

The Splunk Community Slack is undergoing a system migration to keep our workspace secure and ...

Deep Dive: Optimizing Telemetry Pipelines in Splunk Observability Cloud

In this session, we will peel back the layers of Splunk Observability Cloud’s cost-optimization features. ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...