Splunk Search

How can I reduce the storage size of an index, what are the different methods/options?

foundationservi
New Member

Hi,

 

How can I reduce the storage size of an index, what are the different methods/options?

Also, will removing logs using the delete command reduce the storage size of an index?

 

Kind Regards,

Aftab

0 Karma

nordinethales
Explorer

Hello,

better way to reduce the size of index is to reduce retention period, or some other parameter of index configuration. You need splunk admin rights. Some info from the documentation:

Use these indexes.conf settings to configure data retention policies for a SmartStore index:

  • maxGlobalDataSizeMB
  • maxGlobalRawDataSizeMB
  • frozenTimePeriodInSecs

I hope it helps you

Regards

0 Karma

richgalloway
SplunkTrust
SplunkTrust

The delete command doesn't actually delete anything.  It just marks events as hidden so they don't appear in search results so no storage is saved by that command.

The only way to reduce the space used by an index is to wait for Splunk to delete buckets as data ages or times out.  You can accelerate that by changing the retention settings of that index and restarting the indexer(s).

That said, if you are using datamodel acceleration then that will consume storage on your index volume.  That storage can be reduced by disabling DMA that is not used or by reducing the summary window for a DM.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Announcing the Expansion of the Splunk Academic Alliance Program

The Splunk Community is more than just an online forum — it’s a network of passionate users, administrators, ...

Learn Splunk Insider Insights, Do More With Gen AI, & Find 20+ New Use Cases You Can ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Buttercup Games: Further Dashboarding Techniques (Part 7)

This series of blogs assumes you have already completed the Splunk Enterprise Search Tutorial as it uses the ...