Switching my code from Shell to Python and still use Splunk

[alanxu]

Good Morning,
At the moment I have a log file that I am filtering through then outputting with a Shell Script. I put the filtered files in a folder on my desktop that automatically uploads to my local Splunk (changed the .config file). However, I feel like I am doing a shortcut using Shell so I plan on changing it to Python. My end goal is to be able to run my Python script and then have the data uploaded to Splunk and have Splunk monitor the data real time checking there is errors and create a dashboard to hold historic data. I was wondering does the Python SDK help with that? Or does it just help with searches?

[richgalloway · Accepted solution]

Why not use the Spunk Universal Forwarder to send the files to Splunk? You can continue to use a shell or python script to do the filtering, but let the forwarder handle the I/O, retries, etc.

[alanxu]

Oh interesting I never heard of that

[richgalloway]

See http://docs.splunk.com/Documentation/Splunk/6.2.4/Forwarding/Introducingtheuniversalforwarder