topic Re: How can I write a Python script that will backup my current CSV files in Splunk each week? in Getting Data In

How can I write a Python script that will backup my current CSV files in Splunk each week?

ksarode — Fri, 11 Aug 2017 13:14:01 GMT

I want to get a script that will run each week to back up all of my files in a CSV format each week.

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

lfedak_splunk — Mon, 14 Aug 2017 17:42:47 GMT

Hey @ksarode, did you find a solution for your problem? If not do you want to describe in more detail what you are trying to accomplish to see if someone has an answer for you?

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

ksarode — Tue, 15 Aug 2017 10:06:55 GMT

NO i have not received the solution for my question. actually i want a script to take weekly backups of the csv files in splunk.. let me know if you can help me in writing the script.

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

DalJeanis — Tue, 15 Aug 2017 21:41:07 GMT

Where did you want to back them up to?

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

ksarode — Wed, 16 Aug 2017 08:05:44 GMT

on the same location..

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

FritzWittwer_ol — Wed, 16 Aug 2017 11:24:26 GMT

do you intend to run the script on the search head, will it be triggered by cron?

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

ksarode — Wed, 16 Aug 2017 11:32:17 GMT

yes.. i want to run it on search head

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

FritzWittwer_ol — Wed, 16 Aug 2017 12:45:43 GMT

A very lazy solution to keep a daily copy for a week and a monthly copy for a year of the whole $SPLUNK_HOME/etc needs tow simple cron jobs.

50 23 * * * umask 0007 ; tar -czf /opt/splunk/etc-`date +"\%A"`.tgz /opt/splunk/etc > /dev/null 2>&1
55 23 1 * * umask 0007 ; tar -czf /opt/splunk/etc-`date +"\%B"`.tgz /opt/splunk/etc > /dev/null 2>&1

Uses one GB of disk space and allows to recover from any mishaps in the etc directory. You can of course use a find to select just the csv files:

tar -czf /opt/splunk/etc-`date +"\%A"`.tgz `find /opt/splunk/etc -name "*.csv"`

No need for any (python) script at all

Re: How can I write a Python script that will backup my current CSV files in Splunk each week?

ltrand — Wed, 16 Aug 2017 12:53:23 GMT

I don't know that you need a python script to do that. Simple bash will do it. But, if you want to go down that route, here is some help:

Example a basic python backup script:
https://codereview.stackexchange.com/questions/66546/backup-files-script

Example of a closer example that only copies specific files and maintains directory structure:
https://stackoverflow.com/questions/35155382/copying-specific-files-to-a-new-folder-while-maintaining-the-original-subdirect

and a cron formatter so that you can schedule it:
https://www.freeformatter.com/cron-expression-generator-quartz.html

I highly recommend asking these types of questions over at stackexchange or stackoverflow, as there are more people over there equipped to answer that type of a question. Not that the Splunk community can't, but that you'll have more success over there with this type of question.