Monitoring Splunk

Why is data duplication occuring inspite of two independent deployments for splunk?

asunder
New Member

Upon migrating the same logs to a different location and forwarding seperately from those two locations to two independent indexer , there is generation of duplicate events.

Tags (1)
0 Karma

lguinn2
Legend

It makes sense to me that the data was duplicated.

As I understand your description of the situation:

File copy 1 -> read by forwarder A -> sent to indexer A.

File copy 2 -> read by forwarder B -> sent to indexer B.

How would any of the "A" instances know that the second file copy or the "B" instances even existed? If these copies and instances are truly independent, there is no way to avoid the duplication.

Perhaps I don't understand the question properly.

0 Karma
Get Updates on the Splunk Community!

Index This | What is broken 80% of the time by February?

December 2025 Edition   Hayyy Splunk Education Enthusiasts and the Eternally Curious!    We’re back with this ...

Unlock Faster Time-to-Value on Edge and Ingest Processor with New SPL2 Pipeline ...

Hello Splunk Community,   We're thrilled to share an exciting update that will help you manage your data more ...

Splunk MCP & Agentic AI: Machine Data Without Limits

Discover how the Splunk Model Context Protocol (MCP) Server can revolutionize the way your organization uses ...