Getting Data In

Per index archiving

alexander_lucas
Explorer

If I define this in .../local/indexes.conf


[default]
coldToFrozenDir = $SPLUNK_DB/frozenArchive

Will Splunk roll "frozen" buckets from all indexes inside var/lib/splunk/frozenArchive? If so, can this cause conflicts or is there auto-suffix/prefix for file names? My idea was to have a general coldToFrozenDir rather than per index. This would (in theory) take care of new indexes.

1 Solution

gkanapathy
Splunk Employee
Splunk Employee

I'm not sure this will work as you want, but I believe that if you simply put coldToFrozenDir = $SPLUNK_DB/frozenArchive in the indexes.conf file at the top, not under a stanza header, it will have the effect you're looking for. However, please note that once the buckets are rolled into the directory, there is nothing that will tell you what index it originally came from. They will still work and still be usable, but the index name will be lost.

View solution in original post

alexander_lucas
Explorer

it would still be nice to have a $SPUNK_INDEX variable so that one could add a generic coldToFrozenDir var

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

I'm not sure this will work as you want, but I believe that if you simply put coldToFrozenDir = $SPLUNK_DB/frozenArchive in the indexes.conf file at the top, not under a stanza header, it will have the effect you're looking for. However, please note that once the buckets are rolled into the directory, there is nothing that will tell you what index it originally came from. They will still work and still be usable, but the index name will be lost.

alexander_lucas
Explorer

Perhaps there is a special variable for index names?
e.g.
coldToFrozenDir = $SPLUNK_DB/frozenArchive/$SPLUNK_INDEX
then the structure would be:
.../frozenArchive/main
.../frozenArchive/_audit
...[etc]

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Data Outage Monitoring and Reporting

We’ve all been there, right? Living our best life, working on our Splunk environment, when out of nowhere a ...

Manage Datasets and Connections in Catalog on Splunk Cloud Platform

Set Up Data Where You Use It Catalog already helps teams find and understand data across Splunk indexes, ...

Persistent Queue at TcpOut — One of Splunk's Most Practical Features

Splunk introduced persistent queueing at the tcpout layer as one of the most practical resilience features in ...