Hi There,
Recently one of our saved searches have been failing intermittently with the error below, the search is set to trigger an alert when the return count is 0. As it is failing this is the return count and so we are getting false alarms. We have a simple cluster setup with 1 X search head, 1X master, and 2 X indexers. I have checked the time on all three servers and they are synced with the NTP server fine.
The below is returned in the search:
ERROR: [indexer2] Search results may be incomplete, peer searchhead1 search ended prematurely. Error = Peer indexer2 will not return any results for this search, because the search head is using an outdated generation (search head gen_id=35; peer gen_id=36). This can be caused by the peer re-registering and the search head not yet updating to the latest generation. This should resolve itself shortly.
ERROR: [indexer1] Search results may be incomplete, peer searchhead1 search ended prematurely. Error = Peer [indexer1] will not return any results for this search, because the search head is using an outdated generation (search head gen_id=35; peer gen_id=37). This can be caused by the peer re-registering and the search head not yet updating to the latest generation. This should resolve itself shortly.
... View more