topic Re: 500MB/day: How is compressed data counted in Knowledge Management

500MB/day: How is compressed data counted

Katsche — Fri, 26 Aug 2011 09:09:58 GMT

Hey all,

I am trying to handle a large amount of data with splunk. At the same time I have to keep an eye on my 500MB limit. Today i will add some compressed logs. These logs are about 30MB (compressed). Decompressed we are talking about more than 500MB per file.

So I would like to now: How is compressed data counted?

Thanks and kind regards,
Katsche

Re: 500MB/day: How is compressed data counted

Ayn — Fri, 26 Aug 2011 10:17:42 GMT

The data amount that is counted against the license is the amount of uncompressed raw data, i.e. how much data Splunk has to handle when indexing it. So, in your case the amount of data that is counted against the license is the >500MB uncompressed data per file rather than 30MB for the compressed equivalent.