Splunk Search

Delete duplicate events

kml_uvce
Builder

I want to delete duplicate events means want only one event and other same event should be deleted.

kamal singh bisht
Tags (1)
1 Solution

gooza
Communicator

also there is a newer script by zpavic:

see his answer to my question : link:remove duplicates on specific dates

View solution in original post

gooza
Communicator

also there is a newer script by zpavic:

see his answer to my question : link:remove duplicates on specific dates

MuS
SplunkTrust
SplunkTrust

Hi kml_uvce

the answer from gooza is a good one, he links to an app which you download and install into your splunk. afterwards you can run the script remove_duplicate_event.py which will '| delete' the duplicates.

This will not really delete but make the result unsearchable so you will get single results rather then duplicates, read more here

cheers

0 Karma

Ayn
Legend

Well the script is in that app gooza references. Download it and figure out stuff for yourself. We're here to help but you need to do some work on your own as well.

0 Karma

kml_uvce
Builder

First thing I am not seeing any script remove_duplicate_event.py in splunk and second this will delete all events ? I want to keep one event

kamal singh bisht
0 Karma
Get Updates on the Splunk Community!

Data Management Digest – December 2025

Welcome to the December edition of Data Management Digest! As we continue our journey of data innovation, the ...

Index This | What is broken 80% of the time by February?

December 2025 Edition   Hayyy Splunk Education Enthusiasts and the Eternally Curious!    We’re back with this ...

Unlock Faster Time-to-Value on Edge and Ingest Processor with New SPL2 Pipeline ...

Hello Splunk Community,   We're thrilled to share an exciting update that will help you manage your data more ...