Is there any way to NOT duplicate the data when adding CSV file?

[jannsenagustin]

Hello,

Are there any way? In my dashboard the data comes from a CSV file and in order for the dashboard to update, I need to upload the fresh CSV file via Sharepoint, the problem is, when I upload the data, it is duplicated and I don't want to manually filter the old data through Excel and I don't want it duplicated. Any help will be appreciated

Regards,
Jannsen

[HiroshiSatoh]

If it is unique in _raw

Search without searching for duplicates.
(your searcvh)|sort _raw| dedup _raw|(your searcvh)

Periodically delete duplicates.
(your searcvh)|sort _raw|streamstats count by _raw|table count _raw|where count>1|delete