Splunk Search

Uncompressed Data

ryanmims
Explorer

I have just turned on compression and have over 100 GB of uncompressed data. How can I compress it and Splunk still be able to read it?

Let me rephrase. I have 100GB of already indexed uncompressed data. I have just configured compression from the forwarders to the indexers. How do I compress this data so splunk can read it in order to save some disk space?

Tags (2)
0 Karma

dmaislin_splunk
Splunk Employee
Splunk Employee

Neverminf, I misunderstood your question.

0 Karma

ryanmims
Explorer

indexes already compressed when indexed. I just compressed the data for transfer.

0 Karma

dmaislin_splunk
Splunk Employee
Splunk Employee

Just point Splunk at the file. Splunk reads compressed files, but has to go through a single threaded process to decompress each compress file first and then read it in. Why not let Splunk read in uncompressed data and then compress it? Otherwise it would take a long time to read all that compressed data. It's not out of the ordinary to do it though. We see this all the time.

0 Karma
Get Updates on the Splunk Community!

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...