Getting Data In

heavy forwarder multi core?

danan5
Path Finder

Hi,

I see a few similar questions in the past however I can't see an answer to date.

Does anyone know if the splunkd process can utilise modern multicore cpu architectures? or is it bound to a single thread of execution?

The splunk ingest pipeline looks to me (as a non-programmer) as something that might lend itself to multi-threading.

Thanks,
David

0 Karma
1 Solution

codebuilder
Influencer

If you increase the parallel ingestion pipelines on the forwarder (default = 1), it will utilize one core per pipeline.

https://docs.splunk.com/Documentation/Splunk/8.0.1/Indexer/Pipelinesets#Forwarders_and_multiple_pipe...

One caveat worth noting, when handling compressed files (.gz) the forwarder will utilize a single pipeline only, regardless of the pipeline setting.

----
An upvote would be appreciated and Accept Solution if it helps!

View solution in original post

codebuilder
Influencer

If you increase the parallel ingestion pipelines on the forwarder (default = 1), it will utilize one core per pipeline.

https://docs.splunk.com/Documentation/Splunk/8.0.1/Indexer/Pipelinesets#Forwarders_and_multiple_pipe...

One caveat worth noting, when handling compressed files (.gz) the forwarder will utilize a single pipeline only, regardless of the pipeline setting.

----
An upvote would be appreciated and Accept Solution if it helps!
Get Updates on the Splunk Community!

Optimize Cloud Monitoring

  TECH TALKS Optimize Cloud Monitoring Tuesday, August 13, 2024  |  11:00AM–12:00PM PST   Register to ...

What's New in Splunk Cloud Platform 9.2.2403?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.2.2403! Analysts can ...

Stay Connected: Your Guide to July and August Tech Talks, Office Hours, and Webinars!

Dive into our sizzling summer lineup for July and August Community Office Hours and Tech Talks. Scroll down to ...