Splunk Search

Find rogue splunk servers

omgwut56k
Path Finder

I have a list of computers running splunkweb , I am trying to remove results that are logging to the _internal index which would indicate the servers are part of our main infrastructure.

How can I filter out hosts that have reported to events to the _internal index?

Tags (1)
0 Karma

MuS
SplunkTrust
SplunkTrust

Hi omgwut56k,

if I get you correct, you wants to stop or reconfigure some search heads and have them stop forwarding their _internal index - right?

There are a few things you should keep in mind tough:

  • it is not a good practice not to forward the _internal, since it makes troubleshooting much more complicated.
  • What is your intension to do so? If it's about the data amount send, then rather fix any problem on that search head than stop forwarding.
  • If your concern is about license; _internal does not count on the license and has a default retention of 30 days.

But back to your question; this is pretty easy, login to any search head that has all your indexers are search peer and run:

index=_internal | stats count by host

This will get a table of all splunk server sending their _internal events to the indexer.

Hope that helps ...

cheers, MuS

0 Karma

woodcock
Esteemed Legend

Do you perhaps mean main instead of _index?

0 Karma

woodcock
Esteemed Legend

I do not understand; all Splunk servers should log to _index. That is kind of the entire point.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Deep insights, no barriers: Splunk Observability Cloud Free Edition

As software delivery cycles continue to accelerate, observability shouldn’t be a luxury — it should be a ...

Monitoring AI Agents with Splunk Observability Cloud

Let’s say I’m running a travel planning AI app in production. A user asks for three concise hotel options in ...

[Puzzles] Solve, Learn, Repeat: Tiling

This puzzle (first published here) is based on finding groups of tessellated tiles (inspired by floor tiles I ...