topic Re: SPLUNK Forwarder on VIOS in Installation

SPLUNK Forwarder on VIOS

kenbaugher — Fri, 09 Feb 2024 19:38:43 GMT

We just installed the forwarder on one of our VIOS systems to ensure we could get this working, however each time we try to start it up we see the below in our splunkd.log

02-09-2024 13:28:54.797 -0600 WARN ulimit [80544161 MainThread] - A system resource limit on this machine is below the minimum recommended value: system_resource = Data segment size (ulimit -d); current_limit = 134217728; recommended_minimum_value = 536870912. Change the operating system resource limits to meet the minimum recommended values for Splunk Enterprise.

02-09-2024 13:28:54.797 -0600 INFO ulimit [80544161 MainThread] - Limit: data file size: unlimited

02-09-2024 13:28:55.258 -0600 WARN Thread [86376799 HTTPDispatch] - HTTPDispatch: about to throw a ThreadException: pthread_create: Not enough space; 43 threads active. Trying to create batchreader0

We issued the ulimit -d command to update this to unlimited, however still seeing the issue.

Re: SPLUNK Forwarder on VIOS

danielcj — Fri, 09 Feb 2024 19:49:55 GMT

Hello @kenbaugher ,

The ulimit -d configuration will only present the current ulimit configuration.

Please use the following Splunk doc to apply the ulimits configuration:

https://docs.splunk.com/Documentation/Splunk/9.2.0/Troubleshooting/ulimitErrors#Set_limits_using_.2Fetc.2Fsecurity.2Flimits.conf

Thanks.

Re: SPLUNK Forwarder on VIOS

kenbaugher — Tue, 13 Feb 2024 18:41:20 GMT

This was perfect, TY. I updated /etc/security/limits with the appropriate values and all is working now.