Getting Data In

How to remove the duplicate values from json events

Nadhiyaa
Path Finder

alt text

Below is sample data . How to remove the duplicate values

Tags (1)
0 Karma

jawaharas
Motivator

Below configuration will help to remove duplicates in JSON events.

props.conf in Indexer

[<source_type>]
INDEXED_EXTRACTIONS = json
category = Structured

props.conf in Search head

[<source_type>]
AUTO_KV_JSON = false
KV_MODE = none

This answer is based on input from @harsmarvania57. Thanks.

jawaharas
Motivator

@Nadhiyaa
Kindly accept the answer if it helped you, so others can refer it.

0 Karma

harsmarvania57
SplunkTrust
SplunkTrust

Hi,

It looks like you are using INDEXED_EXTRACTIONS = json and KV_MODE = json. If you are using INDEXED_EXTRACTIONS = json while ingesting the data then set KV_MODE = none on Search Head and it will not display duplicate value.

DavidHourani
Super Champion

@Nadhiyaa, are you using stats or dedup ? You shouldnt have duplicated if that's the case. Could you please post your query.

0 Karma
Get Updates on the Splunk Community!

Cannot push config from deployer to search head cluster

Hello,I recently upgraded our deployer/deployment server from 8.1.6 to version 9.0 and when I try to push ...

Subsearch: How to create a search which returns multiple values?

Hi, I have a search query which returns multiple values. For example, the search query returns abc, def, ...

Timecharts look like very flat

<span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Jennifer_0-1656485114286.png" ...