When parsing information from a _json file when using
I am receiving duplicates. I'm not sure why this is happening for my data. The json file is one large flat file that is ingested daily. Would this have to do with ingestion time and search time polling for the explanation? If so, How can I correct this so only single entries are returned for my output?