Search peer intermittently reported down

[phil_wong]

Quite often I saw this warning from dashboard panels.
I have no cue what happened with following message. The search peers didn't look busy at all.

Can someone give any advice? Thanks!!

DistributedPeerManager - Unable to distribute to peer named x.x.x.x:8089 at uri=x.x.x.x:8089 using the uri-scheme=https because peer has status=Down. Verify uri-scheme, connectivity to the search peer, that the search peer is up, and that an adequate level of system resources are available. See the Troubleshooting Manual for more information.

I read this manual but still can't find any obvious delay/disconnect

https://docs.splunk.com/Documentation/Splunk/8.1.1/Troubleshooting/authtimeout

[richgalloway]

The peers may not be busy, but did you confirm the other possibilities reported in the message?  Was the peer up at all times?  Did network connectivity fail at any point?  Does the peer support HTTPS?

[phil_wong]

The peer is up all the times. So I don't think it's HTTPS problem.
I wonder what's the bandwidth between search head and indexers, but you know it takes time to find out...