topic Re: Question about table and duplicate fields in Splunk Search

Question about table and duplicate fields

ddarmand — Thu, 11 Jul 2013 09:02:14 GMT

Hello everyone,

I have a splunk request that creates a table with two fields X and Y and i want to deduplicate lines when there is this situatin :

           X - Y
entry 1 :  A   B
entry 2 :  B   A

how can i do that ? dedup x,y doesn't work 😞

thanks,

Damien

Re: Question about table and duplicate fields

martin_mueller — Thu, 11 Jul 2013 14:18:48 GMT

Those two lines don't look like duplicates to me, so dedup isn't going to throw one out. One would be thrown out if X=A and Y=B is true for both events.

Re: Question about table and duplicate fields

lguinn2 — Thu, 11 Jul 2013 23:06:25 GMT

You could do something like this:

yoursearchhere
| eval compareString = min(X,Y) + max(X,Y)
| dedup compareString
| fields - compareString

I am not entirely sure this will work, but I think it will

Re: Question about table and duplicate fields

ddarmand — Thu, 25 Jul 2013 08:16:41 GMT

thanks a lot