Getting Data In

Index holding data

bharathkumarnec
Contributor

Hi Team,

We wanted to keep one year data in splunk for few of the indexes in our environment, we understand that we can make it in splunk but we need to have additional storage capacity available to achieve this requirement.

What is the best approach to store the data as per our requirement & the data that we store for one year should be fetched at any point in time.

Kindly help me out with best possible option.

TIA

Regards,
BK

0 Karma
1 Solution

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

View solution in original post

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...