Monitoring Splunk

Why is data duplication occuring inspite of two independent deployments for splunk?

asunder
New Member

Upon migrating the same logs to a different location and forwarding seperately from those two locations to two independent indexer , there is generation of duplicate events.

Tags (1)
0 Karma

lguinn2
Legend

It makes sense to me that the data was duplicated.

As I understand your description of the situation:

File copy 1 -> read by forwarder A -> sent to indexer A.

File copy 2 -> read by forwarder B -> sent to indexer B.

How would any of the "A" instances know that the second file copy or the "B" instances even existed? If these copies and instances are truly independent, there is no way to avoid the duplication.

Perhaps I don't understand the question properly.

0 Karma
Get Updates on the Splunk Community!

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...

Cloud Monitoring Console - Unlocking Greater Visibility in SVC Usage Reporting

For Splunk Cloud customers, understanding and optimizing Splunk Virtual Compute (SVC) usage and resource ...

Automatic Discovery Part 3: Practical Use Cases

If you’ve enabled Automatic Discovery in your install of the Splunk Distribution of the OpenTelemetry ...