Deployment Architecture

How much Storage should I be considering?

jesusgalloEMC
Explorer

Hello community,

First of all thank you for taking the time to look at my question.
I will be ingesting the following syslog data and need to do some calculation with the compression ratio and I have the following data:

I need to daily ingest 250GB
Retention needed: 90 days

I calculated 250GB x 90 days or retention = 22.5TB of Storage

BUT! i wasnt considering Compression, after i checked my compression ratio is 50%

Then my question to you will be.
when speaking about 50% of compression ratio, then it means i will be only storing half of the ingested? meaning 125GB out of 250GB?

Meaning my required storage then will be 11.5TB for 90 days?

Please let me know if this is clear, and if i am doing the right approach.

Thank you very much in advance!

Tags (2)
0 Karma

HiroshiSatoh
Champion

That's right. There are also sites like this.
https://splunk-sizing.appspot.com/

You also need a disk to restore the archive area or archive. be careful.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Introducing the 2026 - 2027 SplunkTrust cohort!

The goal of the SplunkTrust™ membership has historically been to acknowledge and recognize those who go above ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...