Getting Data In

Index holding data

bharathkumarnec
Contributor

Hi Team,

We wanted to keep one year data in splunk for few of the indexes in our environment, we understand that we can make it in splunk but we need to have additional storage capacity available to achieve this requirement.

What is the best approach to store the data as per our requirement & the data that we store for one year should be fetched at any point in time.

Kindly help me out with best possible option.

TIA

Regards,
BK

0 Karma
1 Solution

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

View solution in original post

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

Get Updates on the Splunk Community!

Fall Into Learning with New Splunk Education Courses

Every month, Splunk Education releases new courses to help you branch out, strengthen your data science roots, ...

Super Optimize your Splunk Stats Searches: Unlocking the Power of tstats, TERM, and ...

By Martin Hettervik, Senior Consultant and Team Leader at Accelerate at Iver, Splunk MVPThe stats command is ...

How Splunk Observability Cloud Prevented a Major Payment Crisis in Minutes

Your bank's payment processing system is humming along during a busy afternoon, handling millions in hourly ...