Hi All,
Could you please guide us why we are getting this message in our Splunk Web portal and how to trouble shoot this issue?
skipped indexing of internal audit event will keep dropping events until indexer congestion is remedied. Check disk space and other issues that may cause indexer to block
Thanks in advance.
The number one reason that "indexer congestion" occurs is this: the Splunk instance is forwarding to itself.
Check on the indexer: Is a receiving port set? [okay]
Is the indexer forwarding? Where? If it is forwarding to itself, then that's the problem!
You can find both of these settings in the UI under Settings>>Forwarding and Receiving
Or, you can find the receiving settings in inputs.conf and the forwarding settings in outputs.conf
If the indexer is not forwarding to itself, then you can check all the things in Yann's answer that @somesoni2 referenced in his comment...
I got this error message on one of my search head instances (Not indexer), for example.