Knowledge Management

500MB/day: How is compressed data counted

Katsche
Path Finder

Hey all,

I am trying to handle a large amount of data with splunk. At the same time I have to keep an eye on my 500MB limit. Today i will add some compressed logs. These logs are about 30MB (compressed). Decompressed we are talking about more than 500MB per file.

So I would like to now: How is compressed data counted?

Thanks and kind regards,
Katsche

Tags (2)
1 Solution

Ayn
Legend

The data amount that is counted against the license is the amount of uncompressed raw data, i.e. how much data Splunk has to handle when indexing it. So, in your case the amount of data that is counted against the license is the >500MB uncompressed data per file rather than 30MB for the compressed equivalent.

View solution in original post

Ayn
Legend

The data amount that is counted against the license is the amount of uncompressed raw data, i.e. how much data Splunk has to handle when indexing it. So, in your case the amount of data that is counted against the license is the >500MB uncompressed data per file rather than 30MB for the compressed equivalent.

Get Updates on the Splunk Community!

Shape the Future of Splunk: Join the Product Research Lab!

Join the Splunk Product Research Lab and connect with us in the Slack channel #product-research-lab to get ...

Auto-Injector for Everything Else: Making OpenTelemetry Truly Universal

You might have seen Splunk’s recent announcement about donating the OpenTelemetry Injector to the ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...