Monitoring Splunk

Why is data duplication occuring inspite of two independent deployments for splunk?

asunder
New Member

Upon migrating the same logs to a different location and forwarding seperately from those two locations to two independent indexer , there is generation of duplicate events.

Tags (1)
0 Karma

lguinn2
Legend

It makes sense to me that the data was duplicated.

As I understand your description of the situation:

File copy 1 -> read by forwarder A -> sent to indexer A.

File copy 2 -> read by forwarder B -> sent to indexer B.

How would any of the "A" instances know that the second file copy or the "B" instances even existed? If these copies and instances are truly independent, there is no way to avoid the duplication.

Perhaps I don't understand the question properly.

0 Karma
Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...