Problem:
Discovery of the Events Service node using Enterprise Console (EC) fails. Upon checking the EC logs, we see the below error:
Events Service discovery failed.
Failure occurred at stage: Enable transient allocations on masters
Error message:
Task failed: Enable transient allocation in the api store node
Analysis:
This is a very generic error that occurs if the Events Service is failing on its respective node. To get the actual cause of issue, we need to check the events-service-api-store.log
. In the Events Service log for this instance, we see the below error:
[2018-08-07T07:08:42,738+02:00] [ERROR] [ProcessQueue0] [c.a.a.p.e.e.ElasticSearchExecutor] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000004e32c0000, 12294815744, 0) failed; error='Cannot allocate memory' (errno=12)
The system did not have enough memory to allocate the process. Hence, the start of the process failed so the discovery process failed, as well.
Solution:
Ensure that there is enough space available for the Events Service and elastic search process combined so that the process can start and the discovery process will complete successfully.