Getting Data In

Shell script or python to to delete older than 6 months frozen data ?

splunkreal
Influencer

Hello guys,

Would you have an example of shell script or python to to delete older than 6 months frozen data?

Our frozen data is for example in /var/splunk/frozen (it should delete recursively all files older than 6 months)

Thanks in advance.

* If this helps, please upvote or accept solution if it solved *
0 Karma

Richfez
SplunkTrust
SplunkTrust

realsplunk,

For frozen data you can just not use a cold-to-frozen script of directory - by default frozen is deleted and that will resolve your problem going forward. You can search the indexes.conf documentation for "frozen" and get the options that can be set.

Now that you have Frozen files that are older than what you want to retain, this becomes a simple bash/sh script that just runs a single command on the filesystem. Google can give you a more thorough answer than we can provide here - the first few returned hits in this search all do what you need. Obviously test each and adjust to your needs.

Happy Splunking!
-Rich

splunkreal
Influencer

Thanks, I've started this :

*#!/bin/bash

$1 = first arg : main directory

curDateEpo=date +%s;
beforeDateEpo=expr $curDateEpo - 15768000
echo "Current Epoch time: $curDateEpo";
echo "Before 6 months : $beforeDateEpo";
for i in $(find $1 -maxdepth 1 -type d)
do

echo "file $i : ";

printf "\r";

read latest earliest <<<${i//[^0-9]/ };
earliest=${earliest:0:10}
if [ "$earliest" != "" ]
then
earliestH=date -d @$earliest;
# Compare
if [ "$earliest" -lt "$beforeDateEpo" ]
then
echo "$i older";
echo $earliestH;
fi
fi
done*

* If this helps, please upvote or accept solution if it solved *
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

How much can you really learn in 3 minutes?

Observability can certainly be hard to understand – there's a lot of jargon and buzzwords and it seems to ...

Event Series: The Agentic SOC: Trust Before Autonomy

AI is fundamentally changing security operations, but true progress requires more than just automation—it ...

Free Professional Services for .conf26 Attendees

This year at .conf26, we are doing something a little different. We are bringing the best minds from ...