Getting Data In
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Ask a Question

Troubleshooting queuess (parsing queue)

d_lim
Path Finder
‎02-16-2021 09:51 PM

Hi all,

I am having this issue whereby the logs are not coming in from the UF > Local HF > Regional HF > Indexer

There was also a local setting on limits.conf which could it possibly cause the blockup?
[thruput]
maxKBps = 30

 

On the Local HF splunkd.log, these are the errors -

02-17-2021 00:25:12.661 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:25:17.673 -0500 INFO TailReader - ...continuing.
02-17-2021 00:25:23.864 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:24.866 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:27.681 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:25:29.392 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:25:30.533 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:25:42.501 -0500 WARN HttpListener - Connection from 127.0.0.1:49251 didn't send us any data, disconnecting
02-17-2021 00:25:54.856 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:57.724 -0500 INFO TailReader - ...continuing.
02-17-2021 00:26:04.858 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:12.748 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:26:16.869 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:19.874 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:30.777 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:26:42.625 -0500 WARN HttpListener - Connection from 127.0.0.1:49305 didn't send us any data, disconnecting
02-17-2021 00:26:44.558 -0500 INFO TailReader - Continuing...
02-17-2021 00:26:49.560 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:27:31.935 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:27:32.885 -0500 INFO TailReader - ...continuing.
02-17-2021 00:27:33.088 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:27:37.886 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:27:41.867 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:27:42.635 -0500 WARN HttpListener - Connection from 127.0.0.1:49403 didn't send us any data, disconnecting
02-17-2021 00:27:47.902 -0500 INFO TailReader - ...continuing.
02-17-2021 00:27:56.078 -0500 WARN TcpInputProc - Stopping all listening ports. Queues blocked for more than 300 seconds
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 514
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 5514
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 9997
02-17-2021 00:27:57.915 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:33.100 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:28:34.741 -0500 INFO TailReader - Continuing...
02-17-2021 00:28:37.968 -0500 INFO TailReader - ...continuing.
02-17-2021 00:28:39.753 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:41.866 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:28:42.906 -0500 WARN HttpListener - Connection from 127.0.0.1:49528 didn't send us any data, disconnecting
02-17-2021 00:28:42.976 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:44.768 -0500 INFO TailReader - Continuing...
02-17-2021 00:28:49.769 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...02-17-2021 00:25:12.661 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:25:17.673 -0500 INFO TailReader - ...continuing.
02-17-2021 00:25:23.864 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:24.866 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:27.681 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:25:29.392 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname..com_hostname_C83
02-17-2021 00:25:30.533 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:25:42.501 -0500 WARN HttpListener - Connection from 127.0.0.1:49251 didn't send us any data, disconnecting
02-17-2021 00:25:54.856 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:25:57.724 -0500 INFO TailReader - ...continuing.
02-17-2021 00:26:04.858 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:12.748 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:26:16.869 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:19.874 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:26:30.777 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:26:42.625 -0500 WARN HttpListener - Connection from 127.0.0.1:49305 didn't send us any data, disconnecting
02-17-2021 00:26:44.558 -0500 INFO TailReader - Continuing...
02-17-2021 00:26:49.560 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:27:31.935 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:27:32.885 -0500 INFO TailReader - ...continuing.
02-17-2021 00:27:33.088 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:27:37.886 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:27:41.867 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:27:42.635 -0500 WARN HttpListener - Connection from 127.0.0.1:49403 didn't send us any data, disconnecting
02-17-2021 00:27:47.902 -0500 INFO TailReader - ...continuing.
02-17-2021 00:27:56.078 -0500 WARN TcpInputProc - Stopping all listening ports. Queues blocked for more than 300 seconds
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 514
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 5514
02-17-2021 00:27:56.078 -0500 INFO TcpInputProc - Stopping IPv4 port 9997
02-17-2021 00:27:57.915 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:33.100 -0500 INFO HttpPubSubConnection - Running phone uri=/services/broker/phonehome/connection_10.10.10.10_8089_hostname.com_hostname_C83
02-17-2021 00:28:34.741 -0500 INFO TailReader - Continuing...
02-17-2021 00:28:37.968 -0500 INFO TailReader - ...continuing.
02-17-2021 00:28:39.753 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:41.866 -0500 ERROR PipelineComponent - Monotonic time source didn't increase; is it stuck?
02-17-2021 00:28:42.906 -0500 WARN HttpListener - Connection from 127.0.0.1:49528 didn't send us any data, disconnecting
02-17-2021 00:28:42.976 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...
02-17-2021 00:28:44.768 -0500 INFO TailReader - Continuing...
02-17-2021 00:28:49.769 -0500 WARN TailReader - Could not send data to output queue (parsingQueue), retrying...

Labels (2)
0 Karma
Reply

harsmarvania57
Ultra Champion
‎02-17-2021 01:31 AM

Is there any specific reason to set maxKBps=30, that is too low. I have seen that when you set maxKBps too low it causes problem when you have large number of UF.

 

0 Karma
Reply
Get Updates on the Splunk Community!

Enterprise Security Content Update (ESCU) | New Releases

In December, the Splunk Threat Research Team had 1 release of new security content via the Enterprise Security ...

Why am I not seeing the finding in Splunk Enterprise Security Analyst Queue?

(This is the first of a series of 2 blogs). Splunk Enterprise Security is a fantastic tool that offers robust ...

Index This | What are the 12 Days of Splunk-mas?

December 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...