Getting Data In

What are the Best Practices regarding managing queues size?

verbal_666
Builder

Hallo 😊

About this post,
https://community.splunk.com/t5/Building-for-the-Splunk-Platform/Impact-of-increasing-the-queue-size...

What's the Best Practices about managing queues size?

Let's talk about servers running only Splunkd (Indexers and HFs) and 16GB of total physical memory.

Thanks.

Labels (1)
0 Karma

PaulPanther
Builder

As you mentioned in the other thread that the queues are blocked frequently on your indexer and HFs you should think about to scale your infrastrcucture instead of increasing the queues because it does not solve the root cause.

0 Karma

verbal_666
Builder

No, sorry, i did not mention that

INDEXERS manage queues OK, they do not get over 10/20% in a full day, by media is 1/5% per INDEXER.
HF was the issue. Leaving queues by default it can't manage the flows, raising to 2GB it does.

My question is: with 16GB server, is there any risk raising to 2GB per queue, or, maybe, also more over? Best Practices what suggest about it?

For now, with 2GB/queue i got no issues in data flow (and there is much much data!!!).
The only little issue i encountered is that, sometimes, during the day, maybe for some networking problems, i found HF to do much os swap, and, in some cases, kernel killed the splunkd process for full swap usage.

0 Karma
Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Built-in Service Level Objectives Management to Bridge the Gap Between Service & ...

Wednesday, May 29, 2024  |  11AM PST / 2PM ESTRegister now and join us to learn more about how you can ...

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer Certification at ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...