Getting Data In

Splunk HF - Typing Queue full but CPU of the machine is low

GaetanVP
Contributor

Hello Splunkers,

I am currently having parsing problems with my Splunk Heavy Forwarder.
I know I have heavy regex  that are causing Typing Queue problems, but I do not understand why "Splunk is not taking more CPU" on my machine (CPU is always around 10-15%)

Thanks a lot,

GaetanVP  

Labels (1)
0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

View solution in original post

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...