https://community.splunk.com/t5/Splunk-Enterprise/High-system-load-average-on-Search-head-box/m-p/697040#M20023 <P>To add - the only way back was rebooting the machine - then it all works fine</P> Thu, 22 Aug 2024 09:06:37 GMT robertlynch2020 2024-08-22T09:06:37Z https://community.splunk.com/t5/Splunk-Enterprise/High-system-load-average-on-Search-head-box/m-p/696960#M20019 <P>Hi&nbsp;</P> <P>Now and again we get an extremely high system load average on the Search Head.</P> <P>I cant figure out why it is happening and I have to do a kill -9 -1 and restart to fix it.</P> <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="robertlynch2020_0-1724250231479.png" style="width: 400px;"><img src="https://community.splunk.com/t5/image/serverpage/image-id/32341i7C2ADAF062B7A8A7/image-size/medium?v=v2&amp;px=400" role="button" title="robertlynch2020_0-1724250231479.png" alt="robertlynch2020_0-1724250231479.png" /></span></P> <P>This means we can't log into the Splunk GUI.</P> <P>I kill Splunk and I see a lot of processes.</P> <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="robertlynch2020_2-1724250567975.png" style="width: 400px;"><img src="https://community.splunk.com/t5/image/serverpage/image-id/32343i2A8E14E58E3F62C2/image-size/medium?v=v2&amp;px=400" role="button" title="robertlynch2020_2-1724250567975.png" alt="robertlynch2020_2-1724250567975.png" /></span></P> <P>After it is dead, I can still Splunkd process on the box and the load time is still high.</P> <P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="robertlynch2020_0-1724251133750.png" style="width: 400px;"><img src="https://community.splunk.com/t5/image/serverpage/image-id/32344i4F86068C3BD77489/image-size/medium?v=v2&amp;px=400" role="button" title="robertlynch2020_0-1724251133750.png" alt="robertlynch2020_0-1724251133750.png" /></span></P> <P>&nbsp;</P> <P>Regards</P> <P>Robert</P> <P>&nbsp;</P> Wed, 21 Aug 2024 16:00:12 GMT https://community.splunk.com/t5/Splunk-Enterprise/High-system-load-average-on-Search-head-box/m-p/696960#M20019 robertlynch2020 2024-08-21T16:00:12Z https://community.splunk.com/t5/Splunk-Enterprise/High-system-load-average-on-Search-head-box/m-p/697040#M20023 <P>To add - the only way back was rebooting the machine - then it all works fine</P> Thu, 22 Aug 2024 09:06:37 GMT https://community.splunk.com/t5/Splunk-Enterprise/High-system-load-average-on-Search-head-box/m-p/697040#M20023 robertlynch2020 2024-08-22T09:06:37Z