Deployment Architecture

Archiving speed is very very slow

sudhir7
Explorer

I tried to archive data by adding frozenTimePeriodInSecs and coldToFrozenDir settings for individual indexes in local/indexes.conf.
We have 10TB of data to be archive but the rate of archiving was very very slow around 1GB/day.
Has anyone else faced a similar situation ?

0 Karma

Elsurion
Communicator

Your whole index is 10TB and a the day to freeze is how many GB?
My system here is freezing about 10GB/day, but only because the events should be frozen. The Index is about 1TB.
Also the discs are not highspeed just a bunch of normal discs.

0 Karma

sudhir7
Explorer

Hi Elsurion,
Thanks for your reply.
We are using SATA disk, could that be the reason for slowness ?

0 Karma

Elsurion
Communicator

I don't think so. Unless you have just one disc which is used for others as well and not a whole cabinet.
But you could run bonnie++ to check your filesystem for benchmark issues.

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...