Splunk Search

Splunk Storage & Engineering Limits

KarunK
Contributor

Hi All,

Can anyone please advise me regarding the Splunk Engineering limits documents. What i am looking for is :-

  1. How much data the forwarders can handle at a given a point of time ?
  2. How much data can indexers can ingest ?
  3. What is the storage requirements for Splunk ?

etc etc

Thanks in advance.

Tags (3)
1 Solution

ChrisG
Splunk Employee
Splunk Employee

I agree, your questions really pertain to hardware rather than the core software. I suggest you read Hardware capacity planning for your Splunk deployment in the Installation Manual for some guidance.

View solution in original post

tmeader
Contributor

Going by the Splunk guidelines doc is good for a start. We've found that the ability to laterally upgrade by just adding more indexers has been a very viable solution (even if the hardware is not that great). At the moment we're using 4 Indexers that are now over 3 year old hardware, easily handling ~80GB a day. One thing to NOT skimp on is your I/O back-end. Get the fastest disks you possibly can, preferably RAID10.

0 Karma

KarunK
Contributor

Thanks for your Response. Appreciate that.

0 Karma

ChrisG
Splunk Employee
Splunk Employee

I agree, your questions really pertain to hardware rather than the core software. I suggest you read Hardware capacity planning for your Splunk deployment in the Installation Manual for some guidance.

KarunK
Contributor

Thanks for your Response. Appreciate that.

0 Karma

treinke
Builder

I believe this is more a limitation of your hardware than the Splunk software. I personally have easily done 150GB in a day of data. I there are customers out there that are doing around 1TB or more of data a day.

There are no answer without questions
0 Karma

KarunK
Contributor

Thanks for your Response. Appreciate that.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Introducing the 2026 - 2027 SplunkTrust cohort!

The goal of the SplunkTrust™ membership has historically been to acknowledge and recognize those who go above ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...