Getting Data In

DMC ALert - Missing forwarder for zombie entry

afx
Contributor

Hi,
I am getting a DMC alert for a missing forwarder even though that one (at least by client name, but not UUID) exists.

Backgroud story:
Forwarder was deleted completely on source system (don't ask...).
Re-Installed from scratch with same parameters (of course, still different UUID, but same client name) and slightly newer code version.
Rebuilt the forwarders DB on the deployment server (Monitoring Console -> Settings -> Forwarder Monitoring Setup -> Rebuild forwarder assets).
Still I get errors about the missing forwarder and it shows the old version number for the code.

So where is this Zombie stored and how do I get rid of it?

thx
afx

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi afx,
did you tried to rebuild the lookup "dmc_forwarder_assets" [Settings -- Forwarder Monitoring Setup -- Rebuild Forwarder Assets].
In this way you rebuild your lookup with only the UFs that are really sending logs in the last period (configurable).

Bye.
Giuseppe

0 Karma

afx
Contributor

Hi Guiseppe,
yes, as described in my post.

But, your post suddenly triggered my leaky memory.
It is not the deployment server where these alerts are generated but the search head for various strange reasons (modifed DMC alert with some lookups that are only maintained on the search head that make the alert more informative).

So once I did the DB refresh on the search head the world went quiet again.

thx
afx

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi afx,
if this answer solved your problem (or helped to do), please accept and/or upvote it.
Bye and see next time.
Giuseppe

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...