How can I get rid of "Connection refused" for Deep Learning Toolkit setup?

[davietch]

Hi,

I am setting up the Deep Learning Toolkit (https://splunkbase.splunk.com/app/4607/) but the connexion to the docker instance does not work.

What I did:
- Install docker and add the containers needed
- Docker runs as root
- Install Splunk + Machine Learning Toolkit (+ python maths librairies) + Deep Learning toolkit
- The user running Splunk belongs to the docker group

When I fill in the form in the set up page of the app with the information about docker (single-instance type), I get this error:
UnixHTTPConnectionPool(host='localhost', port=None): Max retries exceeded with url: /v1.35/_ping (Caused by : [Errno 13] Permission denied)

In the internal logs, I also see logs like this:

ConnectionError: UnixHTTPConnectionPool(host='localhost', port=None): Max retries exceeded with url: /v1.35/containers/json?size=0&filters=%7B%22label%22%3A+%5B%22mltk_container%22%5D%7D&limit=-1&all=0&trunc_cmd=0 (Caused by : [Errno 13] Permission denied)

Can you help me to make this work?

[ephemeric]

As usual always check SELinux and perms on `/var/run/docker.sock`.

[rfujara_splunk · Accepted solution]

Could you please check this Docker docs page:
https://docs.docker.com/install/linux/linux-postinstall/#manage-docker-as-a-non-root-user

It may be because the user running Splunk is not allowed to talk to Docker.

[davietch]

Turns out the permissions were OK but I needed a login/logout to apply the permissions.. Just that.

Thanks all !

[pdrieger_splunk]

Hi @davietch, can you please cross check this answer and see if connecting to tcp instead of the unix://var/run/docker.sock helps in your case, too: https://answers.splunk.com/answers/811981/deep-learning-toolkit-setup.html

[davietch]

Hi,

No, it didn't work:

• With Localhost:

  HTTPConnectionPool(host='localhost', port=2375): Max retries exceeded with url: /v1.35/_ping (Caused by : [Errno 111] Connection refused)

• With the name of the server:

  HTTPConnectionPool(host='myservername', port=2375): Max retries exceeded with url: /v1.35/_ping (Caused by : [Errno 111] Connection refused)

[pdrieger_splunk]

Hi @davietch , to me it looks like your docker host can not be reached from the DLTK which tries to establish a connection but fails.

• for the last case: Can you cross check with this post here if you haven't: https://github.com/docker/docker-py/issues/290
• for your initial connection, assuming your docker connection was defined this way: Docker Host: unix://var/run/docker.sock Endpoint URL: localhost External URL: localhost Can you double check that your docker deamon socket is enabled: https://docs.docker.com/engine/reference/commandline/dockerd/#daemon-socket-option

Let us know if it can be resolved with that.

[PavelP]

what is the host OS? CentOS/Ubuntu? Try to disable SELinux/Apparmor.

[davietch]

Hi,

My OS is RedHat 7.7

SELinux is already disabled:

[aaa@XXXX~]$ sestatus
SELinux status:                 disabled

I don't see any Apparmor software installed.