Splunk Dev

SPL query to find dublicate records injected to Splunk

Alankrit
New Member

Hi Team,

One of our customer reported that he was finding duplicate records in splunk ( duplicate files and duplicate data in files). We want to simulate the scenario in our lab. If someone can help to write SPL to find duplicate records.

 

Regards,

Alankrit

0 Karma

VatsalJagani
SplunkTrust
SplunkTrust

@Alankrit- Below is the search you can use. But just to clarify few points:

  • This search is not very efficient and do not meant for reporting and only meant for troubleshooting purposes so you can find the source of duplicate events.
index=* sourcetype=* host=* | stats count by index, sourcetype, host, _raw | where count>1

 

I hope this helps!!! Kindly upvote if it does!!!

0 Karma
Get Updates on the Splunk Community!

Developer Spotlight with Brett Adams

In our third Spotlight feature, we're excited to shine a light on Brett—a Splunk consultant, innovative ...

Index This | What can you do to make 55,555 equal 500?

April 2025 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with this ...

Say goodbye to manually analyzing phishing and malware threats with Splunk Attack ...

In today’s evolving threat landscape, we understand you’re constantly bombarded with phishing and malware ...