any ramifications for enabling dedup on NFS

[sonicZ]

We have a NFS mount on a EMC NS 480 and about enable dedup to see if we can reduce the size of a cold storage mount point. Any ramifications enabling dedup?
even though splunk's data is compressed, will it help restore some disk space?

[dwaddle · Accepted solution]

Well, I don't think it will hurt anything, but you may not get any substantial space back. Given this is a cold bucket volume you speak of, I don't think there's any risk of data loss/corruption/etc ... or, at least, it's acceptable risk.

I've not used the EMC kit, and can't speak to the quality of their dedup. However, I have put data similar to Splunk (but not Splunk exactly) onto a deduped Netapp volume and was disappointed with the space savings.

The compressed rawdata files will probably not deduplicate at all, and the tsidx files may only dedup slightly. However, I would recommend at least copying some data to a test volume and doing a dedup on it and seeing where it winds up...

[sonicZ]

Thanks for the reply Dwaddle, it's lower risk data for us a not so critical index(in terms of needing data for audits etc)

I'll compare space savings before / after.