Splunk Dev

SPL query to find dublicate records injected to Splunk

Alankrit
New Member

Hi Team,

One of our customer reported that he was finding duplicate records in splunk ( duplicate files and duplicate data in files). We want to simulate the scenario in our lab. If someone can help to write SPL to find duplicate records.

 

Regards,

Alankrit

0 Karma

VatsalJagani
SplunkTrust
SplunkTrust

@Alankrit- Below is the search you can use. But just to clarify few points:

  • This search is not very efficient and do not meant for reporting and only meant for troubleshooting purposes so you can find the source of duplicate events.
index=* sourcetype=* host=* | stats count by index, sourcetype, host, _raw | where count>1

 

I hope this helps!!! Kindly upvote if it does!!!

0 Karma
Get Updates on the Splunk Community!

Mastering Data Pipelines: Unlocking Value with Splunk

 In today's AI-driven world, organizations must balance the challenges of managing the explosion of data with ...

The Latest Cisco Integrations With Splunk Platform!

Join us for an exciting tech talk where we’ll explore the latest integrations in Cisco + Splunk! We’ve ...

AI Adoption Hub Launch | Curated Resources to Get Started with AI in Splunk

Hey Splunk Practitioners and AI Enthusiasts! It’s no secret (or surprise) that AI is at the forefront of ...