Splunk Search

How to remove Duplicate values in different field?

alexspunkshell
Contributor

How to remove duplicate values in a different field

|stats count by src dest

alexspunkshell_0-1660244580972.png

 

Labels (3)
Tags (2)
0 Karma
1 Solution

yuanliu
SplunkTrust
SplunkTrust

The most straightforward implementation is

| stats count by src dest
| where src != dest

Alternatively,

| where src != dest
| stats count by src dest

 

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

Where are the duplicates?  I see the first 3 octets of some IP addresses match, but stats looks at the entire field, not just parts of it.  If you need to deduplicate on the first 3 octets, then use rex or split to extract it into a new field and dedup on that new field.

---
If this reply helps you, Karma would be appreciated.

alexspunkshell
Contributor

@richgalloway  Thanks for the reply

I am getting similar IPs in both src & dest fields.

So I want to remove in results if both src & dest are the same.

0 Karma

yuanliu
SplunkTrust
SplunkTrust

The most straightforward implementation is

| stats count by src dest
| where src != dest

Alternatively,

| where src != dest
| stats count by src dest

 

Taruchit
Contributor

Hi @alexspunkshell,

Please confirm if I understood your requirement correctly: -

There are two fields in the result: - src and dest.

If in a given row both src and dest are same, then you need to filter out those rows from the result.

Thank you

0 Karma

alexspunkshell
Contributor

@Taruchit  You are right.

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...