I have some RHEL servers that are my splunk indexers that have been crashing lately. They all get into the same Out Of Memory state and the box is effectively hung.
There's nothing of note in /v...
...d Crashes related to incompatible Python2 code in Apps that prevented splund from starting. Disabled offending apps from command-line and... all good. New System is 56GB memory, 16 v...
...rror 4 in splunkd[55ad1f3d2000+2e2b000]*
This is from one of the crash logs.
Received fatal signal 11 (Segmentation fault).
Cause:
No memory mapped at address [0x00000261CB7ECF]....
...crashes 100% - crash logs looks like below; - Resource usage is low as in CPU IDLE 99% memory usages is less than 10%. - systemd and bootstart enabled [build 545206cc9f70] 2...
...ystemd
#configurations, and is used when enabling boot-start for Splunk on
#systemd-based Linux distributions.
[Unit]
Description=Systemd service file for Splunk, generated by 'splunk enable boot-start'
A...
...erformance and catastrophic breakdown in system responsiveness under high memory pressure. Please fix by setting the values for transparent huge pages to "madvise" or preferably "never" via sysctl, kernel...
Splunk universal forwarder crashes here are crash logs: [build de405f4a7979] 2023-07-10 17:31:30 Received fatal signal 11 (Segmentation fault) on PID 3013854. Cause: No memory mapped at a...
...roblems with Splunk. Typical symptoms include generally reduced performance and catastrophic breakdown in system responsiveness under high memory pressure. Please fix by setting the values for t...
I'm seeing the error below under messages in my Splunk enterprise console:
Missing or malformed messages.conf stanza for TCPOUT:FORWARDING_BLOCKED_Indexer IP ADDress_default-autolb-group DC-Host N...