Splunk DB Connect "The Task Server is currently unavailable"

[ww9rivers26]

Just did a fresh install of Splunk Enterprise 10.0.3, set up HTTPS with the web service, then installed Splunk DB Connect 4.21. The host runs RHEL 9.7. Java is openjdk 11.0.25 2024-10-15 LTS.

Set up and started Splunkd service. Logged in. The Splunk DB Connect app shows a message:

The Task Server is currently unavailable. Please check your settings.

I have had issues with the "task server" and I have been able to resolve them with proper Java settings. But not this time.

I tried to manually run the task server. The bin/server.sh script simply hangs. While that happens, I can find the java process that runs the server.jar but no port 9998 open.

Also, in the splunkd.log, this error shows up every few seconds:
failed to run task server, error=com.splunk.dbx.exception.HttpConnectionException: An error occurred while processing the HTTP request.
So it seems that it is possibly a problem between the task server with the Splnkd service itself? May be on the management port 8089?

[nonno_pinto]

We also had a similar issue, couple times and each time with a different cause.

Once, we had an error in the JAVA path: the server manager changed it and the db connect app cannot find it, we had to change the JAVA path in the UI of the app.

Lately, it was an issue with the server certification. We solved by running this command

cp $SPLUNK_PATH$/bin/auth/server.pem $SPLUNK_PATH$/bin/auth/server.pem_bk

rm $SPLUNK_PATH$/bin/auth/server.pem 

and reloading splunk. Sometimes it get some error with the certificate and it just need to recreate it.

[ww9rivers26]

Thank you for the response.

I think you mean `$SPLUNK_HOME/etc/auth/server.pem`. However, we are using a third-party CA signed cert for the server's web UI. So I cannot let Splunk creating a self-signed cert.

In our installations, these files are replaced with appropriate certs and key:

etc/auth/cacert.pem
etc/auth/server.pem
etc/auth/splunkweb/cert.pem
etc/auth/splunkweb/privkey.pem