Splunk Search

Why isnt the dedup command not working in some fields?

payton_tayvion
Path Finder

Im having an issue where my contact field and l2 field is showing duplicates of the same name and when i use the dedup command nothing happens. Here's the command:
| tstats count(Vulnerabilities.signature) as "Total Vulnerabilities" from datamodel="Vulnerabilities" where (nodename="Vulnerabilities" Vulnerabilities.severity="high" OR Vulnerabilities.severity="critical" Vulnerabilities.dest_bunit IN (*) Vulnerabilities.property IN (*)) by Vulnerabilities.signature Vulnerabilities.property
| rename Vulnerabilities.property AS Property
| lookup kv_opsdb property as Property output contact
| lookup aws_accounts account_number AS Property OUTPUT account_name
| eval Property=if(isnull(account_name), Property, account_name)
| lookup workday.csv shortid as contact output l2
| sort - "Total Vulnerabilities"
| dedeup l2

Heres the result:
Vulnerabilities.signature Total Vulnerabilities Contact L2
CentOS 7 : bind (CESA-2019:1294) 129345 Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe

and it goes on for a couple more hundred times. i just need the contact name and l2 showing once

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi payton_tayvion,
ay first probably it's a copy error, but at the end you have dedeup instead dedup.
Then are there differences using or not the sort command?
Then have you more than 50,000 results? if yes add 0 to the sort command ( | sort 0 l2 ).

Bye.
Giuseppe

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...