Splunk Search

multi_threaded_setup parameter in limits.conf

splunkIT
Splunk Employee
Splunk Employee

We are currently looking at improving CPU optimization on the Splunk environment. We have found that the limits.conf contain the following option :

multi_threaded_setup = [0|1]
* Flag indicating whether to use multiple threads when setting up distributed search to multiple peers.
* Defaults to false (0)

I have done tests in the lab on both the search head and the indexer and I can't see any behavior change looking at the threads number. How should we activate this option and is it worth it?

the_wolverine
Champion

We just discovered that the default/limits.conf uses "false" as the value for multi_threaded_setup. Now we wonder if using true/false would not work properly if set in local/limits.conf as per the spec file [0|1].

From default/limits.conf:

whether to use multiple threads when setting up distributed search to multiple peers

multi_threaded_setup = false

0 Karma

splunkIT
Splunk Employee
Splunk Employee

The multi_threaded_setup parameter in limits.conf does not have any direct relation to CPU optimization. This parameter may be helpful for distributed search environment where you have dozens of search PEERS implemented, but in most case this parameter should be left alone. Generally, we don't recommend users to make any modification to the limits.conf file, with the exceptions of some specific cases.

Perhaps this Splunk Answers thread may help in answering your questions in regarding to CPU optimization:

http://splunk-base.splunk.com/answers/12027/singlemulti-threading-cpu

splunkIT
Splunk Employee
Splunk Employee

Search peers/indexers.

multi_threaded_setup = [0|1]
* Flag indicating whether to use multiple threads when setting up distributed search to multiple peers.
* Defaults to false (0)

0 Karma

the_wolverine
Champion

SplunkIT: "This parameter may be helpful for distributed search environment where you have dozens of search heads" Do you mean "search peers" (typically, indexers) OR did you mean search HEADS?

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

Correct, this parameter only controls multi-threading of the connection establishment to many distributed search peers. Typically the time take for this is negligible, but if you have lots of them it may matter. HOWEVER, due to issues in the SSL libraries that Splunk uses today (September 2012), if you want to use this parameter, you must disable SSL on the search peers splunkd.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...