Getting Data In

Index holding data

bharathkumarnec
Contributor

Hi Team,

We wanted to keep one year data in splunk for few of the indexes in our environment, we understand that we can make it in splunk but we need to have additional storage capacity available to achieve this requirement.

What is the best approach to store the data as per our requirement & the data that we store for one year should be fetched at any point in time.

Kindly help me out with best possible option.

TIA

Regards,
BK

0 Karma
1 Solution

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

View solution in original post

woodcock
Esteemed Legend

Keep it in warm and make sure that you have enough disk space allotted to contain it (with fudge factor). There is a tool referenced here than can help:

https://www.splunk.com/blog/2015/02/18/splunk-sizing-made-easy.html

The best option, though, is roll up aggregate summary details regarding your raw events (perhaps daily totals/averages) and save this to a Summary Index which will vastly reduce the amount of storage required:

https://docs.splunk.com/Documentation/Splunk/6.6.0/Knowledge/Usesummaryindexing

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Tuning Edge Processor in Hybrid Mode: What Limits Each Data Path

When you run Edge Processor in hybrid mode, alongside a Splunk heavy forwarder on the same host, two questions ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Request for Professional Development: Attending .conf26

Winning Over the Boss: Your Pass to .conf26 conf26 is going to be here before you know it. If don't already ...