Monitoring Splunk

How is my indexed data stored/compressed on disk?

mctester
Communicator

We created a new index called "foo"; its size is about 6.6GB on disk. Our main index "main" is 66GB.

Our daily indexing volume stat went from about 1.7GB (before adding index ens) to > 19GB. How is that possible? Should not that stats have gone up about 10%?

Tags (2)
0 Karma
1 Solution

Mick
Splunk Employee
Splunk Employee

The rawdata within the index is compressed, so we try to make the actual disk footprint as small as possible. If you want to take a copy of one of the files in $SPLUNK_DB/foo/db//rawdata and uncompress it to assess the compression ratio, go right ahead.

View solution in original post

Mick
Splunk Employee
Splunk Employee

The rawdata within the index is compressed, so we try to make the actual disk footprint as small as possible. If you want to take a copy of one of the files in $SPLUNK_DB/foo/db//rawdata and uncompress it to assess the compression ratio, go right ahead.

Get Updates on the Splunk Community!

Splunkbase | Splunk Dashboard Examples App for SimpleXML End of Life

The Splunk Dashboard Examples App for SimpleXML will reach end of support on Dec 19, 2024, after which no new ...

Understanding Generative AI Techniques and Their Application in Cybersecurity

Watch On-Demand Artificial intelligence is the talk of the town nowadays, with industries of all kinds ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...