Getting Data In

Restore Data Question

hartfoml
Motivator

I have this retention settings like this

[firewall]

maxHotBuckets = 3
frozenTimePeriodInSecs = 48211200
maxTotalDataSizeMB = 1000000

I found out that the buckets were timed by the size and not the date.

I changed the maxTotalDataSizeMB and restored the old buckets to a restore directory.

I CP -rp the old buckets to the production firewall/db directory but I am not seeing the logs in the UI.

Do I need to restore to the "colddb" or "thaweddb"?

Can I just copy the buckets back into the production db?

Do I have to restart splunkd to read the data in the buckets?

Tags (2)
0 Karma
1 Solution

hartfoml
Motivator

So the above answer is for archived data. that is archived by splunk.

In my case I do a full back of the index files every month. Thanks to support guru "Joshua Backing" I found out that if you restore live buckets from tape and the bucket ID dose not conflict with any other live bucket you can just copy the bucket back to the /indexname/db directory then stop and start splunkd and whala the data is viable.

I did notice that many of the buckets moved to the /indexname/colddb right away. Again thanks to Joshua, he said this could be for normal more than 300 warm bucket rotation. the data is still searchable and will not be rotated out of the database until the size or time policy is reached.

Thanks again Joshua Splunk Support Rules

View solution in original post

0 Karma

hartfoml
Motivator

So the above answer is for archived data. that is archived by splunk.

In my case I do a full back of the index files every month. Thanks to support guru "Joshua Backing" I found out that if you restore live buckets from tape and the bucket ID dose not conflict with any other live bucket you can just copy the bucket back to the /indexname/db directory then stop and start splunkd and whala the data is viable.

I did notice that many of the buckets moved to the /indexname/colddb right away. Again thanks to Joshua, he said this could be for normal more than 300 warm bucket rotation. the data is still searchable and will not be rotated out of the database until the size or time policy is reached.

Thanks again Joshua Splunk Support Rules

0 Karma

kristian_kolb
Ultra Champion

just make sure that you increase the retention time/index size limits of the index before you copy the buckets back, otherwise the bucket will be dropped once again...

0 Karma

kristian_kolb
Ultra Champion

Here is the step-by-step instruction for how to restore archived (i.e. frozen) data;

http://docs.splunk.com/Documentation/Splunk/6.0/Indexer/Restorearchiveddata

/k

0 Karma

lukejadamec
Super Champion

In addition to that, you don't need to restart splunk when you move functional buckets to a production db, because splunk will automatically update the manifest over time. If you want the data immediately, then a restart will do that.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Get Agentic with Splunk Lantern: Connect to Cisco Cloud Control, Transform ...

Splunk Lantern is Splunk’s customer success center that provides practical guidance from Splunk experts on key ...

July Community Events: Master ITSI 5.0 & Automate Splunk

Struggling with alert fatigue or feeling like you're spending more time on infrastructure maintenance than ...

New Release of Federated Search: Bringing Splunk Analytics to More of Your Data

Organizations today are generating more data than ever and storing it across cloud object stores, data lakes, ...