Getting Data In

Splunk HF - Typing Queue full but CPU of the machine is low

GaetanVP
Contributor

Hello Splunkers,

I am currently having parsing problems with my Splunk Heavy Forwarder.
I know I have heavy regex  that are causing Typing Queue problems, but I do not understand why "Splunk is not taking more CPU" on my machine (CPU is always around 10-15%)

Thanks a lot,

GaetanVP  

Labels (1)
0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

View solution in original post

gcusello
SplunkTrust
SplunkTrust

Hi @GaetanVP,

on Heavy Forwarder you can use parallel pipeline to optimize your CPU use.

here you can find indications for indexers, but it's the same for HFs: https://docs.splunk.com/Documentation/Splunk/9.0.3/Indexer/Pipelinesets

In few words, you have to put in [general] stanza of server.conf:

parallelIngestionPipelines = 2

You cannot put an higher value event if you have more CPUs.

Ciao.

Giuseppe

Get Updates on the Splunk Community!

Splunk Observability Synthetic Monitoring - Resolved Incident on Detector Alerts

We’ve discovered a bug that affected the auto-clear of Synthetic Detectors in the Splunk Synthetic Monitoring ...

Video | Tom’s Smartness Journey Continues

Remember Splunk Community member Tom Kopchak? If you caught the first episode of our Smartness interview ...

3-2-1 Go! How Fast Can You Debug Microservices with Observability Cloud?

3-2-1 Go! How Fast Can You Debug Microservices with Observability Cloud? Learn how unique features like ...