Deployment Architecture

Is it "safe" to copy buckets across indexers when buckets get corrupt?

ddrillic
Ultra Champion

On our index cluster, certain buckets got corrupt on one indexer. Is it possible to copy a bucket from a healthy indexer over the corrupt one?

Tags (1)
0 Karma

Masa
Splunk Employee
Splunk Employee

(Answer to this old question)
Yes, possible as a workaround. In general, if you delete the corrupted bucket (splunk must be stopped, and remove the bucket and restart it again), Cluster Master should detect Replication factor is not met, and create a copy to a cluster peer.

In v6.5, there is action in fix-up bucket status page and select "remove/resync, etc"

If it is pre-v6.5, "remove_from_peer" REST call may be useful without stopping Splunk.
( ref: http://docs.splunk.com/Documentation/Splunk/6.5.2/RESTREF/RESTclusterExamples )

If that is failing, potentially somehow source bucket itself is corrupted. I would suggest to run;

splunk fsck repair --one-bucket --bucket-path=<bucket_path>

Hope this helps for people visiting this answer.

0 Karma
Get Updates on the Splunk Community!

Fall Into Learning with New Splunk Education Courses

Every month, Splunk Education releases new courses to help you branch out, strengthen your data science roots, ...

Super Optimize your Splunk Stats Searches: Unlocking the Power of tstats, TERM, and ...

By Martin Hettervik, Senior Consultant and Team Leader at Accelerate at Iver, Splunk MVPThe stats command is ...

How Splunk Observability Cloud Prevented a Major Payment Crisis in Minutes

Your bank's payment processing system is humming along during a busy afternoon, handling millions in hourly ...