Getting Data In

duplicate data indexing

shivanandbm
Explorer

i see duplicate data getting indexed.its impacting license. can you please suggest how i can fix this.below is the monitoring .
[monitor:///incoming/XXXXX/XXXX/XXXXX.gz]
disabled = false

whitelist = ..gz

index = XXXXX
sourcetype = XXXX
EVENT_BREAK_ENABLE=true

Tags (1)
0 Karma

MuS
SplunkTrust
SplunkTrust

Please add your outputs.conf to this post.

cheers, MuS

0 Karma

sathwikr076
Communicator

Hi, How many indexers you have and how you are confirming that the duplicate data is ingesting. If those duplicate logs are from same application servers and exactly same in format, Splunk is smart enough to drop the duplicate logs.

0 Karma
Get Updates on the Splunk Community!

AI for AppInspect

We’re excited to announce two new updates to AppInspect designed to save you time and make the app approval ...

App Platform's 2025 Year in Review: A Year of Innovation, Growth, and Community

As we step into 2026, it’s the perfect moment to reflect on what an extraordinary year 2025 was for the Splunk ...

Operationalizing Entity Risk Score with Enterprise Security 8.3+

Overview Enterprise Security 8.3 introduces a powerful new feature called “Entity Risk Scoring” (ERS) for ...