Splunk Search

Dedup performance 1 field vs multiple fields vs concatenated field

wfskmoney
Path Finder

Which one would be faster or better in general:

  1. | dedup fieldA fieldB --> I would assume that Splunk does a concatenation in the background
  2. | eval fieldAB = fieldA.fieldB | dedup fieldAB
0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi wfskmoney,
I didn't found great differences between the methods (a few hundredths of a second):
scan ot 700,000 events in 8.568 s. in the first case and 8.529 s. in thesecond case.

Bye.
Giuseppe

View solution in original post

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi wfskmoney,
I didn't found great differences between the methods (a few hundredths of a second):
scan ot 700,000 events in 8.568 s. in the first case and 8.529 s. in thesecond case.

Bye.
Giuseppe

0 Karma
Get Updates on the Splunk Community!

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...