Getting Data In

How do disk space issues occur in Splunk indexers and what are the options to troubleshoot or prevent this from happening?

Kaushikkatta03
Explorer

I was trying to figure it out how disk space issues occur in the indexers and what are the possible outcomes to get on from it?

0 Karma
1 Solution

renjith_nair
Legend

Splunk Enterprise stores all of the data it processes in indexes. An index is a collection of databases, which are subdirectories located in $SPLUNK_HOME/var/lib/splunk. Indexes consist of two types of files: rawdata files and index files.

Splunk does compression of data when it's writing to the disk However, the more you store, the more disk space will be used.

You can implement data retention in splunk using bucket rolling (internal splunk mechanism) . Below link will give you an idea about how the index and bucket works.

https://wiki.splunk.com/Deploy:BucketRotationAndRetention

As mentioned in the link, you can change parameters in the indexes.conf to adjust data retension.

http://docs.splunk.com/Documentation/Splunk/6.3.3/Admin/Indexesconf

---
What goes around comes around. If it helps, hit it with Karma 🙂

View solution in original post

renjith_nair
Legend

Splunk Enterprise stores all of the data it processes in indexes. An index is a collection of databases, which are subdirectories located in $SPLUNK_HOME/var/lib/splunk. Indexes consist of two types of files: rawdata files and index files.

Splunk does compression of data when it's writing to the disk However, the more you store, the more disk space will be used.

You can implement data retention in splunk using bucket rolling (internal splunk mechanism) . Below link will give you an idea about how the index and bucket works.

https://wiki.splunk.com/Deploy:BucketRotationAndRetention

As mentioned in the link, you can change parameters in the indexes.conf to adjust data retension.

http://docs.splunk.com/Documentation/Splunk/6.3.3/Admin/Indexesconf

---
What goes around comes around. If it helps, hit it with Karma 🙂
Get Updates on the Splunk Community!

Splunk Enterprise Security 8.0.2 Availability: On cloud and On-premise!

A few months ago, we released Splunk Enterprise Security 8.0 for our cloud customers. Today, we are excited to ...

Logs to Metrics

Logs and Metrics Logs are generally unstructured text or structured events emitted by applications and written ...

Developer Spotlight with Paul Stout

Welcome to our very first developer spotlight release series where we'll feature some awesome Splunk ...