When I have searched in search head, following message was displayed.
error: Some events cannot be displayed because they cannot be fetched from the remote search peer(s). This is likely caused by the natural expiration of the related remote search jobs. To view the omitted events, run the search again.
Also, recently I feel search performance is slow.
Then I investigated cause of this problem, and found following log in each search peer.
What can be considered as this cause other than "Insufficient value of ulimit on Indexer side" and "Network problem"?
Also, if there is a possibility that there is a network problem, will information for determining it be output to the internal log?
If anyone know about it, please tell me...
Health Checks on your
Monitoring Console, it will probably tell you that you have some combination of these 5 problems on your Indexers; fix ALL OF THEM:
1: THP is on 2: ulimits too low 3: Too few cores 4: Too little RAM 5: Too slow disk I/O
I can't find problem with
Also cpu usage and memory usage is not too high.
The only point of concern is that the utilization of the partition where the
warm data of each Indexer are stored is close to 95%, so is this related?