Splunk Search

How does dedup treat multivalue fields?

landen99
Motivator

Which events are removed when multivalue comes into play?

0 Karma

landen99
Motivator

The answer on which values in a multivalue field are deduped is this: The multivalue field must match all values in order for it to be deduped:

| stats count | eval field=mvappend("a","b") | append [| stats count | eval field=mvappend("1","2")] | append [| stats count | eval field=mvappend("2","1")] | append [| stats count | eval field=mvappend("a1","b2")] | append [| stats count | eval field=mvappend("a1","b2")] | append [| stats count | eval field=mvappend("a1","a2")] | dedup field

Even the order of the values in the multivalue field matters! Who would've thought?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...

Event Series: Mastering AI Tokenomics and Splunk Agent Observability

Beyond the Black Box: Correlating AI Performance and Tokenomics with Splunk Agent Observability   As ...