Getting Data In

Splunk HF - Typing Queue full but CPU of the machine is low

GaetanVP
Contributor

Hello Splunkers,

I am currently having parsing problems with my Splunk Heavy Forwarder.
I know I have heavy regex  that are causing Typing Queue problems, but I do not understand why "Splunk is not taking more CPU" on my machine (CPU is always around 10-15%)

Thanks a lot,

GaetanVP  

Labels (1)
0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

View solution in original post

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

Get Updates on the Splunk Community!

Easily Improve Agent Saturation with the Splunk Add-on for OpenTelemetry Collector

Agent Saturation What and Whys In application performance monitoring, saturation is defined as the total load ...

Explore the Latest Educational Offerings from Splunk [January 2025 Updates]

At Splunk Education, we are committed to providing a robust learning experience for all users, regardless of ...

Developer Spotlight with Paul Stout

Welcome to our very first developer spotlight release series where we'll feature some awesome Splunk ...