Deployment Architecture

Archiving speed is very very slow

sudhir7
Explorer

I tried to archive data by adding frozenTimePeriodInSecs and coldToFrozenDir settings for individual indexes in local/indexes.conf.
We have 10TB of data to be archive but the rate of archiving was very very slow around 1GB/day.
Has anyone else faced a similar situation ?

0 Karma

Elsurion
Communicator

Your whole index is 10TB and a the day to freeze is how many GB?
My system here is freezing about 10GB/day, but only because the events should be frozen. The Index is about 1TB.
Also the discs are not highspeed just a bunch of normal discs.

0 Karma

sudhir7
Explorer

Hi Elsurion,
Thanks for your reply.
We are using SATA disk, could that be the reason for slowness ?

0 Karma

Elsurion
Communicator

I don't think so. Unless you have just one disc which is used for others as well and not a whole cabinet.
But you could run bonnie++ to check your filesystem for benchmark issues.

0 Karma
Get Updates on the Splunk Community!

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to Officially Supported Splunk ...

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI! Discover how Splunk’s agentic AI ...