topic Re: Force python3 on custom commands in Splunk Search

Force python3 on custom commands

cpm003 — Tue, 17 Sep 2019 11:58:57 GMT

Hi all,
I´ve a custom command but it requieres python3 for launch properly.

Errors on job inspector:

09-17-2019 13:49:30.497 INFO  ChunkedExternProcessor - Running process: /opt/splunk/bin/python /opt/splunk/etc/apps/arcsightapi/bin/bypass.py
09-17-2019 13:49:30.666 ERROR ChunkedExternProcessor - stderr: Error in sitecustomize; set PYTHONVERBOSE for traceback:
09-17-2019 13:49:30.666 ERROR ChunkedExternProcessor - stderr: AttributeError: module 'sys' has no attribute 'setdefaultencoding'
09-17-2019 13:49:30.666 ERROR ChunkedExternProcessor - Failed attempting to parse transport header: module 'requests.packages.urllib3' has no attribute 'disable_warnings'

if i exec under terminal with python3 support works nice:

root@horsell:/opt/splunk/bin# ./splunk cmd python3 ../etc/apps/arcsightapi/bin/client.py  -h
Error in sitecustomize; set PYTHONVERBOSE for traceback:
AttributeError: module 'sys' has no attribute 'setdefaultencoding'
usage: client.py [-h] [-a AREA] [-s SOURCE] [-q SEARCH_QUERY]
                 [-ts START_QUERY] [-te END_QUERY] [-tl TIME_LIMIT]

Any idea to solve this?
Regards.

Re: Force python3 on custom commands

richgalloway — Tue, 17 Sep 2019 13:28:54 GMT

Splunk will support python3 in an upcoming release.

Re: Force python3 on custom commands

starcher — Tue, 17 Sep 2019 18:55:14 GMT

https://www.splunk.com/blog/2019/07/01/admins-and-developers-we-re-transitioning-to-python-3.html

Re: Force python3 on custom commands

kiril123 — Fri, 20 Sep 2019 12:55:40 GMT

I have the same problem. It was working in 6.6 but not in 7.3.1

Re: Force python3 on custom commands

nilendra19888 — Wed, 30 Sep 2020 02:19:45 GMT

Hi ,

You can write a wrapper script to use the python3 available on your system to execute the custom commands.

import os
import subprocess

_NEW_PYTHON_PATH = '/opt/rh/python27/root/usr/bin'
_SPLUNK_PYTHON_PATH = os.environ['PYTHONPATH']

os.environ['PYTHONPATH'] = _NEW_PYTHON_PATH
my_process = os.path.join(os.getcwd(), 'test.py')

p = subprocess.Popen([os.environ['PYTHONPATH'], my_process, _SPLUNK_PYTHON_PATH],
stdin=subprocess.PIPE, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
output = p.communicate()[0]
print output