https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31906#M6636 <P>Going by the Splunk guidelines doc is good for a start. We've found that the ability to laterally upgrade by just adding more indexers has been a very viable solution (even if the hardware is not that great). At the moment we're using 4 Indexers that are now over 3 year old hardware, easily handling ~80GB a day. One thing to NOT skimp on is your I/O back-end. Get the fastest disks you possibly can, preferably RAID10.</P> Fri, 20 Apr 2012 17:41:39 GMT tmeader 2012-04-20T17:41:39Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31903#M6633 <P>Hi All,</P> <P>Can anyone please advise me regarding the Splunk Engineering limits documents. What i am looking for is :-</P> <OL> <LI>How much data the forwarders can handle at a given a point of time ?</LI> <LI>How much data can indexers can ingest ?</LI> <LI>What is the storage requirements for Splunk ?</LI> </OL> <P>etc etc</P> <P>Thanks in advance.</P> Fri, 20 Apr 2012 05:33:38 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31903#M6633 KarunK 2012-04-20T05:33:38Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31904#M6634 <P>I believe this is more a limitation of your hardware than the Splunk software. I personally have easily done 150GB in a day of data. I there are customers out there that are doing around 1TB or more of data a day.</P> Fri, 20 Apr 2012 13:10:25 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31904#M6634 treinke 2012-04-20T13:10:25Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31905#M6635 <P>I agree, your questions really pertain to hardware rather than the core software. I suggest you read <A href="http://docs.splunk.com/Documentation/Splunk/latest/Installation/CapacityplanningforalargerSplunkdeployment">Hardware capacity planning for your Splunk deployment</A> in the Installation Manual for some guidance.</P> Fri, 20 Apr 2012 15:52:27 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31905#M6635 ChrisG 2012-04-20T15:52:27Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31906#M6636 <P>Going by the Splunk guidelines doc is good for a start. We've found that the ability to laterally upgrade by just adding more indexers has been a very viable solution (even if the hardware is not that great). At the moment we're using 4 Indexers that are now over 3 year old hardware, easily handling ~80GB a day. One thing to NOT skimp on is your I/O back-end. Get the fastest disks you possibly can, preferably RAID10.</P> Fri, 20 Apr 2012 17:41:39 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31906#M6636 tmeader 2012-04-20T17:41:39Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31907#M6637 <P>Thanks for your Response. Appreciate that.</P> Tue, 01 May 2012 06:09:23 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31907#M6637 KarunK 2012-05-01T06:09:23Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31908#M6638 <P>Thanks for your Response. Appreciate that.</P> Tue, 01 May 2012 06:09:39 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31908#M6638 KarunK 2012-05-01T06:09:39Z https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31909#M6639 <P>Thanks for your Response. Appreciate that.</P> Tue, 01 May 2012 06:09:41 GMT https://community.splunk.com/t5/Splunk-Search/Splunk-Storage-Engineering-Limits/m-p/31909#M6639 KarunK 2012-05-01T06:09:41Z