Splunk Search

Is anyone utilizing deduplication at the storage level (SAN) for Splunk data and how does it perform?

dustyblahblah
New Member

Is anyone utilizing deduplication on storage arrays for Splunk volumes, and how does it perform?

Tags (3)
0 Karma

my2ndhead
SplunkTrust
SplunkTrust

What is your goal?

You will benefit from space savings only for replicated buckets (index replication).

The buckets themselves, as they are already compressed with gzip, will not-dedup very well, if at all.

dustyblahblah
New Member

No real goal in mind, just a curiosity. Our environment will be growing soon, so the R5 LUN (very low search usage, so R10 was not needed) will need to be changed to R10. With change in storage, we have option to move system and utilize a NetApp device with Dedupe. I am just looking at options. It seems like this is not one.

0 Karma

thomrs
Communicator

We have dedup on our Netapp and no issues, my storage guy is happy with the space saved.

Note this is for our cold storage. For hot/warm you want pure speed, I use a local raid 10 array there.

0 Karma
Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...