How to remove the duplicates from index in continuous monitoring?

[harinivgr]

I have added one text file for continuous monitoring. The data's getting duplicated in the same index eventhough data's are added or removed or for no change in text file also. How to remove duplicates from index without using dedup command?

[p_gurav]

Try using delete command:

https://docs.splunk.com/Documentation/Splunk/7.3.1/SearchReference/Delete

Also, this may help to find out duplicates events:
http://www.manvir.net/remove-duplicate-events-from-splunk/