Getting Data In

Logs stopped from one of the server

asharmaeqfx
Path Finder

Hi Splunkers,

 

I am facing a strange issue like the splunk forwarder stopped forwarding data. I see the forwarder is working fine and as per the splunk logs I see

The monitor input cannot produce data because splunkd's processing queues are full. This will be caused by inadequate indexing or forwarding rate, or a sudden burst of incoming data

I tried restarting the indexers and forwarder. It works for a while and after that it stops. 

Could you please advice.

Thanks,
Amit

Labels (1)
0 Karma
1 Solution

vamshiangothu
Engager

Hi,

check the following 

1. check your splunk forwarder version in server

2. check if firewall opened for the server

3. check the sever record in splunk forwarder management(splunk web-settings-forwarder management)

4. if splunk forwarder service is stopped in server. Please restart the service by running services.msc in command prompt

 

it will help you.

View solution in original post

asharmaeqfx
Path Finder

Hi All,

 

Thanks for your kind replies.

 

I have to delete some big logs and after that restarted the Splunk forwarder. It has been working since Friday.

As per your suggestion i think it was because the amount of logs which were being forwarded seems to be quite big and did not allow it to be forwarder and queues were getting full.

 

Regards,

Amit

0 Karma

scelikok
SplunkTrust
SplunkTrust

Hi @asharmaeqfx,

You can search in indexer's internal log for "The index processor has paused data flow". This log will show you the reason why it does not accept data. It may be a free disk space problem too.

If this reply helps you an upvote and "Accept as Solution" is appreciated.

vamshiangothu
Engager

Hi,

check the following 

1. check your splunk forwarder version in server

2. check if firewall opened for the server

3. check the sever record in splunk forwarder management(splunk web-settings-forwarder management)

4. if splunk forwarder service is stopped in server. Please restart the service by running services.msc in command prompt

 

it will help you.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

A Four-Part Event Series: Full Stack Observability For the AI Era

As AI reshapes applications, infrastructure, and the way teams operate, the traditional boundaries of ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...