Splunk Search

Command to free disk space

erlindemberg
Explorer

My instance of Splunk currently has 9.4 TB of disk for indexing. We have 360GB per day being indexed and I can't increase the disk size to support this daily indexing.
I need to clean up indexed events from January 2019 through July 2019.

Can someone tell me how to do it and which command to use?

Tags (1)
0 Karma
1 Solution

alonsocaio
Contributor

I would suggest you to read about archiving, this could be a better way to safely free some disk space, not losing permanently all data you have indexed before: https://docs.splunk.com/Documentation/Splunk/7.3.1/Indexer/Setaretirementandarchivingpolicy

Using a correct archiving and retirement policy can help you to remove or backup old indexed data, since you can choose to archive frozen buckets or to remove them. You just need to set when you want a bucket to turn to frozen.

View solution in original post

0 Karma

richgalloway
SplunkTrust
SplunkTrust

If the size of your disk is a limiting factor then your indexes' retention should be based on size rather than time. Put your indexes in a volume and limit the size of the volume to the size of the disk minus 10-15%. As space grows tight, older buckets will be deleted to make room for new ones.

---
If this reply helps you, Karma would be appreciated.
0 Karma

alonsocaio
Contributor

I would suggest you to read about archiving, this could be a better way to safely free some disk space, not losing permanently all data you have indexed before: https://docs.splunk.com/Documentation/Splunk/7.3.1/Indexer/Setaretirementandarchivingpolicy

Using a correct archiving and retirement policy can help you to remove or backup old indexed data, since you can choose to archive frozen buckets or to remove them. You just need to set when you want a bucket to turn to frozen.

0 Karma

richgalloway
SplunkTrust
SplunkTrust

I'm tempted to down-vote this answer. The splunk clean command deletes the entire index, something the OP doesn't want.

---
If this reply helps you, Karma would be appreciated.
0 Karma

alonsocaio
Contributor

I removed the splunk clean command from my answer, thanks for the advice.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Where Innovation Takes Flight: The Splunk4Aviation Flight Sim Lands at .conf26

If you hear someone at .conf26 shouting "gear down, GEAR DOWN" across the show floor, you have found us.  The ...

Turn Cisco Telemetry Into Action with Cisco Data Fabric, powered by the Splunk ...

The surge in machine data is already hitting enterprise budgets, and the agentic era will only intensify it. ...

Persistent Queue at TcpOut — One of Splunk's Most Practical Features

Splunk introduced persistent queueing at the tcpout layer as one of the most practical resilience features in ...