Splunk Search

Delete duplicate events

kml_uvce
Builder

I want to delete duplicate events means want only one event and other same event should be deleted.

kamal singh bisht
Tags (1)
1 Solution

gooza
Communicator

also there is a newer script by zpavic:

see his answer to my question : link:remove duplicates on specific dates

View solution in original post

gooza
Communicator

also there is a newer script by zpavic:

see his answer to my question : link:remove duplicates on specific dates

MuS
SplunkTrust
SplunkTrust

Hi kml_uvce

the answer from gooza is a good one, he links to an app which you download and install into your splunk. afterwards you can run the script remove_duplicate_event.py which will '| delete' the duplicates.

This will not really delete but make the result unsearchable so you will get single results rather then duplicates, read more here

cheers

0 Karma

Ayn
Legend

Well the script is in that app gooza references. Download it and figure out stuff for yourself. We're here to help but you need to do some work on your own as well.

0 Karma

kml_uvce
Builder

First thing I am not seeing any script remove_duplicate_event.py in splunk and second this will delete all events ? I want to keep one event

kamal singh bisht
0 Karma
Get Updates on the Splunk Community!

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...

Cloud Monitoring Console - Unlocking Greater Visibility in SVC Usage Reporting

For Splunk Cloud customers, understanding and optimizing Splunk Virtual Compute (SVC) usage and resource ...

Automatic Discovery Part 3: Practical Use Cases

If you’ve enabled Automatic Discovery in your install of the Splunk Distribution of the OpenTelemetry ...