Splunk Search

How can I reduce the storage size of an index, what are the different methods/options?

foundationservi
New Member

Hi,

 

How can I reduce the storage size of an index, what are the different methods/options?

Also, will removing logs using the delete command reduce the storage size of an index?

 

Kind Regards,

Aftab

0 Karma

nordinethales
Path Finder

Hello,

better way to reduce the size of index is to reduce retention period, or some other parameter of index configuration. You need splunk admin rights. Some info from the documentation:

Use these indexes.conf settings to configure data retention policies for a SmartStore index:

  • maxGlobalDataSizeMB
  • maxGlobalRawDataSizeMB
  • frozenTimePeriodInSecs

I hope it helps you

Regards

0 Karma

richgalloway
SplunkTrust
SplunkTrust

The delete command doesn't actually delete anything.  It just marks events as hidden so they don't appear in search results so no storage is saved by that command.

The only way to reduce the space used by an index is to wait for Splunk to delete buckets as data ages or times out.  You can accelerate that by changing the retention settings of that index and restarting the indexer(s).

That said, if you are using datamodel acceleration then that will consume storage on your index volume.  That storage can be reduced by disabling DMA that is not used or by reducing the summary window for a DM.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Introduction to Splunk AI

How are you using AI in Splunk? Whether you see AI as a threat or opportunity, AI is here to stay. Lucky for ...

Splunk + ThousandEyes: Correlate frontend, app, and network data to troubleshoot ...

Are you tired of troubleshooting delays caused by siloed frontend, application, and network data? We've got a ...

Maximizing the Value of Splunk ES 8.x

Splunk Enterprise Security (ES) continues to be a leader in the Gartner Magic Quadrant, reflecting its pivotal ...