Splunk Search

Is there a dedup command to remove events that have same timestamp?

mlm
Explorer

hello guys,

Is there any way that I could remove duplicate events that have same timestamp using this below search string:

 

index=* (EventCode=4624 OR EventCode=4625)
| stats count(Keywords) as Attempts, count(eval(match(Keywords,"Audit Failure"))) as Failed,
count(eval(match(Keywords,"Audit Success"))) as Success
earliest(_time) as FirstAttempt latest(_time) as LatestAttempt by Account_Name
| where Attempts>=5 AND Success>=1 AND Failed>=2
| eval FirstAttempt=strftime(FirstAttempt,"%x %X")
| eval LatestAttempt=strftime(LatestAttempt,"%x %X")

 



The output:

Account_Name Attempts Failed Success FirstAttempt LatestAttempt

 

 

Labels (3)
0 Karma

ITWhisperer
SplunkTrust
SplunkTrust
index=* (EventCode=4624 OR EventCode=4625)
| dedup _time
| stats count(Keywords) as Attempts, count(eval(match(Keywords,"Audit Failure"))) as Failed,
count(eval(match(Keywords,"Audit Success"))) as Success
earliest(_time) as FirstAttempt latest(_time) as LatestAttempt by Account_Name
| where Attempts>=5 AND Success>=1 AND Failed>=2
| eval FirstAttempt=strftime(FirstAttempt,"%x %X")
| eval LatestAttempt=strftime(LatestAttempt,"%x %X")
0 Karma

mlm
Explorer

hey @ITWhisperer thanks for the reply. unfortunately, it didn't work - it is giving me a "no result found"

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

The dedup worked, the issue is that probably the events needed to complete the rest of the query have probably been removed. You will need to be more precise about which events you want to remove.

0 Karma

mlm
Explorer

yeah, so basically, i want to monitor user account's event 4624 & 4625 by attempts, the problem is that there are bunch of duplicate events with same timestamp so i want to remove those and have a unique count

0 Karma

ITWhisperer
SplunkTrust
SplunkTrust

You could try

 

| dedup _time EventCode

or

| dedup _time EventCode Account_Name

 

mlm
Explorer

Awesome!! This one actually works! Thank you so much sir!

0 Karma
Get Updates on the Splunk Community!

Database Performance Sidebar Panel Now on APM Database Query Performance & Service ...

We’ve streamlined the troubleshooting experience for database-related service issues by adding a database ...

IM Landing Page Filter - Now Available

We’ve added the capability for you to filter across the summary details on the main Infrastructure Monitoring ...

Dynamic Links from Alerts to IM Navigators - New in Observability Cloud

Splunk continues to improve the troubleshooting experience in Observability Cloud with this latest enhancement ...