topic Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected" in Deployment Architecture

DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

Vinesh93 — Tue, 05 Mar 2019 12:24:25 GMT

We have a client that connected to Splunk Deployment server where we get an error "DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected". Ping and telnet to the Deployment server works fine and when we try to add some data into splunk its not getting indexed due to the above error. Is there any possible solutions available for this scenario?

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

lakshman239 — Tue, 05 Mar 2019 13:35:59 GMT

I assume you are telnet'ing from both DS to your client and vice versa on the port 8089 (or as per your deployment). Did you restart the client? do you see any other errors/warning in client's splunkd.log?

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

tsaikumar009 — Tue, 05 Mar 2019 15:56:52 GMT

the connection from your server to DS should be two way on port 8089 only the apps will be deployed to the instances.

check the connection from Server to DS on 8089 and also from DS to Server on same port 8089. If both works this error should not occur.

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

Vinesh93 — Wed, 06 Mar 2019 04:35:15 GMT

Yes, telnet from both end is fine. Also restarted the client, even after restarting the client the same error "err=not_connected" is generated in splunkd.log and new events are not getting indexed.

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

Vinesh93 — Wed, 06 Mar 2019 04:37:22 GMT

@tsaikumar009 telnet from both end is fine but still im getting this error and new events are not getting indexed. Am I missing anything here ?

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

tsaikumar009 — Wed, 06 Mar 2019 14:37:28 GMT

super in that case, the issue would be that in the monitor stanza for certain log paths might be different in that hosts. I faced the same issue, i cleared duplicate monitor stanzas for same log paths and logs started rolling post that.

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected"

Gavrikova — Fri, 03 Apr 2020 13:48:58 GMT

I read a lot of comments about the error DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected

To summarize what I found out:

This error is about the connection between DC and DS, so it doesn't affect the possibility of your forwarder to upload the logs. But if there's a problem with DC - DS communication your DC can be unable to deploy apps to your forwarders (like outputs or inputs), so your forwarder doesn't know where to take logs and where to forward.

What you can check on forwarder:

Is your DS uri set properly: $SPLUNK_HOME/bin/splunk show deploy-poll
Is there a network connection between DC and DS. For example using telnet <DS-uri> 8089 (if you didn't change management port)
Is your forwarder showing on DS in clients tab and when it phoned home for the last time.
Did your forwarder get the apps from DS. They shoud be located in directories like this: $SPLUNK_HOME/etc/apps/<your_app_name>/local/
The version of Splunk forwarder.

In my case my forwarder wasn't showing on DS in clients tab, but the DS uri was correct. And there were no problems with the network connectivity. But I resolved the issue by upgrading the forwarder from 6.2.5 to 7.0.2. And on indexers I have 7.2.1.

Hope it's helpful.

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected&

mannyk1splunk — Wed, 23 Nov 2022 22:25:39 GMT

Hi All,

Have you got a resolution to this issue. We are facing similar issue.

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending handshake message to DS; err=not_connected&

vasunder — Thu, 16 Mar 2023 16:51:31 GMT

Hi All,

Did anyone got a resolution to this issue. We are facing similar issue.

Thank You

Re: DC:DeploymentClient - channel=tenantService/handshake Will retry sending han

codewire — Sun, 23 Jul 2023 18:45:55 GMT

I updated firewall rules to allow traffic traffic from DC and issue was resolved.