Splunk Dev

SPL query to find dublicate records injected to Splunk

Alankrit
New Member

Hi Team,

One of our customer reported that he was finding duplicate records in splunk ( duplicate files and duplicate data in files). We want to simulate the scenario in our lab. If someone can help to write SPL to find duplicate records.

 

Regards,

Alankrit

0 Karma

VatsalJagani
SplunkTrust
SplunkTrust

@Alankrit- Below is the search you can use. But just to clarify few points:

  • This search is not very efficient and do not meant for reporting and only meant for troubleshooting purposes so you can find the source of duplicate events.
index=* sourcetype=* host=* | stats count by index, sourcetype, host, _raw | where count>1

 

I hope this helps!!! Kindly upvote if it does!!!

0 Karma
Get Updates on the Splunk Community!

Unleash Unified Security and Observability with Splunk Cloud Platform

     Now Available on Microsoft AzureOn Demand Now Step boldly into the AI revolution with enhanced security ...

Enterprise Security Content Update (ESCU) | New Releases

In March, the Splunk Threat Research Team had 2 releases of security content via the Enterprise Security ...

Join the Splunk Developer Program Hackathon: Splunk Build-a-thon!

The Splunk Developer Program is launching in beta, and we’re celebrating with an exciting hackathon! This is ...