When parsing information from a _json file when using
|spath
|search
|table
I am receiving duplicates. I'm not sure why this is happening for my data. The json file is one large flat file that is ingested daily. Would this have to do with ingestion time and search time polling for the explanation? If so, How can I correct this so only single entries are returned for my output?
My guess, somewhere along the data pipe you have a props.conf
which has INDEXED_EXTRACTIONS = JSON
and on your search head you have a props.conf
with KV_MODE = json
.
Use just one of them, not both 😉
cheers, MuS