Getting Data In

Shell script or python to to delete older than 6 months frozen data ?

splunkreal
Motivator

Hello guys,

Would you have an example of shell script or python to to delete older than 6 months frozen data?

Our frozen data is for example in /var/splunk/frozen (it should delete recursively all files older than 6 months)

Thanks in advance.

* If this helps, please upvote or accept solution if it solved *
0 Karma

Richfez
SplunkTrust
SplunkTrust

realsplunk,

For frozen data you can just not use a cold-to-frozen script of directory - by default frozen is deleted and that will resolve your problem going forward. You can search the indexes.conf documentation for "frozen" and get the options that can be set.

Now that you have Frozen files that are older than what you want to retain, this becomes a simple bash/sh script that just runs a single command on the filesystem. Google can give you a more thorough answer than we can provide here - the first few returned hits in this search all do what you need. Obviously test each and adjust to your needs.

Happy Splunking!
-Rich

splunkreal
Motivator

Thanks, I've started this :

*#!/bin/bash

$1 = first arg : main directory

curDateEpo=date +%s;
beforeDateEpo=expr $curDateEpo - 15768000
echo "Current Epoch time: $curDateEpo";
echo "Before 6 months : $beforeDateEpo";
for i in $(find $1 -maxdepth 1 -type d)
do

echo "file $i : ";

printf "\r";

read latest earliest <<<${i//[^0-9]/ };
earliest=${earliest:0:10}
if [ "$earliest" != "" ]
then
earliestH=date -d @$earliest;
# Compare
if [ "$earliest" -lt "$beforeDateEpo" ]
then
echo "$i older";
echo $earliestH;
fi
fi
done*

* If this helps, please upvote or accept solution if it solved *
0 Karma
Get Updates on the Splunk Community!

Unlock Database Monitoring with Splunk Observability Cloud

  In today’s fast-paced digital landscape, even minor database slowdowns can disrupt user experiences and ...

Purpose in Action: How Splunk Is Helping Power an Inclusive Future for All

At Cisco, purpose isn’t a tagline—it’s a commitment. Cisco’s FY25 Purpose Report outlines how the company is ...

[Upcoming Webinar] Demo Day: Transforming IT Operations with Splunk

Join us for a live Demo Day at the Cisco Store on January 21st 10:00am - 11:00am PST In the fast-paced world ...