topic Why is my bash scripted input failing on Ubuntu while it's OK on other distros? in Getting Data In

Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

D2SI — Sun, 25 Nov 2018 23:20:43 GMT

Hello,

I have an issue with a scripted input.

I have 2 Linux on Amazon Web Services (AWS) :

1 based one AWS Linux AMI
1 based on Ubuntu

On AWS Linux Amazon Machine Image (AMI) :

script is OK when launched manually
script is OK when launched by Splunk via scripted input

On Ubuntu :

script is OK when launched manually
script KO when launched by Splunk via scripted input

I would get errors like:

Error in sitecustomize; set PYTHONVERBOSE for traceback
AttributeError: module 'sys' has no attribute 'setdefaultencoding'
prepare_body() takes 3 positional arguments but 4 were given

I do not know why it even mention Python since it is a bash script.

I try each line of the script one by one but, via Splunk it fails at things such as :

\#!/usr/bin/env bash

set -o nounset

START_TIME="${SECONDS}"

---> Fails saying SECONDS is not declared and since using 'set -o nounset'.

But SECONDS is an internal variable, and since :

I do not meet that issue in other ways script is launched (on Linux AMI & manually on Ubuntu)
I get other weird errors for other small instructions anyhow

Hence, sorry for not posting more clear error examples, but since the script seems all OK in other contexts as mentioned, I feeI feel like I am missing something in the way the script is being launched by Splunk.

Is there anything specific I should take into account running a bash script from Splunk on Ubuntu ?

Is there a way to launch such a script using a Splunk command like it can be done for Python using "splunk cmd python script.py" ?

Thanks in advance for any hints!

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

dauren_akilbeko — Mon, 26 Nov 2018 02:01:01 GMT

Is there a way to launch such script
using Splunk command like it can be
done for Python using "splunk cmd
python script.py" ?
splunk cmd script.sh

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

D2SI — Mon, 26 Nov 2018 08:37:28 GMT

Thanks,

'splunk cmd script.sh' seems to be working only with the scripted copied to $SPLUNK_HOME/bin, but it works!

And it generates the same errors I see when launched from the scripted input.

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

dauren_akilbeko — Mon, 26 Nov 2018 11:34:36 GMT

Did you check permissions on th script file?
Also can you run some other arbitrary script (Echo something), to see if it also fails.

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

woodcock — Mon, 26 Nov 2018 19:54:04 GMT

Try adding this to the very top of your script:

unset LD_LIBRARY_PATH

If that doesn't do it, try adding this ALSO (keep the above line, too):

unset PYTHONPATH

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

D2SI — Tue, 29 Sep 2020 22:08:05 GMT

Thanks a lot ! With both, it works on Ubuntu and still works on AWS Linux AMI so it's perfect.

I tried to run echo $LD_LIBRARY_PATH & $PYTHONPATH, it returned an empty line on both distros.

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

D2SI — Tue, 27 Nov 2018 05:56:06 GMT

Yes I had double checked on permissions.

Yes "echo something" would work on Ubuntu, but errors would raise as soon as I introduce small instructions.

Re: Why is my bash scripted input failing on Ubuntu while it's OK on other distros?

woodcock — Fri, 07 Dec 2018 14:58:10 GMT

This drove me crazy until I figured it out. I forget how long it took...