Splunk Enterprise

Splunk website monitoring Thread limit reached

Ramesh_Euddham
Engager

Hello all,

We have encountered a performance issue with our website monitoring inputs. It appears that the thread limit reached, causing multiple input executions to be skipped. This led to a significant load on our server, and eventually, the website monitoring app stopped functioning.

2025-08-19 15:59:59,634 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,567 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,537 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,387 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,360 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,332 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,300 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,236 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,209 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,182 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,156 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,131 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200
2025-08-19 15:59:59,105 WARNING Thread limit has been reached and thus this execution will be skipped for stanza=XXXX, thread_count=200

This is happening frequently  and restarting Splunk isn't helping. 

If anyone has experienced similar issues or has suggestions on how to manage thread limits more effectively  your input would be greatly appreciated

Labels (1)
0 Karma

livehybrid
SplunkTrust
SplunkTrust

Hi @Ramesh_Euddham 

Under the Configuration page/tab for the Website Monitoring app, what do you have under Thread Limit? 

It sounds like you have more website checks configured than the amount of threads and the add-on is skipping some of your checks. Consider increasing this limit to see if this resolves the issue.

livehybrid_0-1755868980475.png

The relevant code for this is at https://raw.githubusercontent.com/LukeMurphey/splunk-website-monitoring/442d08de5bbfed4a879de3b537ea...

https://raw.githubusercontent.com/LukeMurphey/splunk-website-monitoring/442d08de5bbfed4a879de3b537ea...

 

Ramesh_Euddham
Engager

Hi @livehybrid,

I initially increased the thread limit to 300, but it continued to hit the maximum threshold, causing failures when processing new inputs. Interestingly, the issue was resolved when I reduced the limit to 100.


However, after upgrading to Splunk Enterprise version 9.4.5, the problem resurfaced. I’ve now lowered the thread limit to 50, and it appears to be stable again.


Any insights or recommendations to help prevent this issue from recurring in the future would be greatly appreciated.


0 Karma
Get Updates on the Splunk Community!

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Shape the Future of Splunk: Join the Product Research Lab!

Join the Splunk Product Research Lab and connect with us in the Slack channel #product-research-lab to get ...