Monitoring Splunk

Why is data duplication occuring inspite of two independent deployments for splunk?

asunder
New Member

Upon migrating the same logs to a different location and forwarding seperately from those two locations to two independent indexer , there is generation of duplicate events.

Tags (1)
0 Karma

lguinn2
Legend

It makes sense to me that the data was duplicated.

As I understand your description of the situation:

File copy 1 -> read by forwarder A -> sent to indexer A.

File copy 2 -> read by forwarder B -> sent to indexer B.

How would any of the "A" instances know that the second file copy or the "B" instances even existed? If these copies and instances are truly independent, there is no way to avoid the duplication.

Perhaps I don't understand the question properly.

0 Karma
Get Updates on the Splunk Community!

What the End of Support for Splunk Add-on Builder Means for You

Hello Splunk Community! We want to share an important update regarding the future of the Splunk Add-on Builder ...

Solve, Learn, Repeat: New Puzzle Channel Now Live

Welcome to the Splunk Puzzle PlaygroundIf you are anything like me, you love to solve problems, and what ...

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...