Getting Data In

How to avoid duplicated event

Path Finder

We have csv type of data file which is overwritten and with new data appended to the end every night. I found Splunk load/duplicate all the data again everyday!

As I know crcSalt only check CRC with first few lines of the file. How Splunk works in this case to identify only end of the file has new data?

followTail works for file replace?

Tags (3)
0 Karma


How are you loading the file:

Are you using a Splunk monitor?

That might be your problem.

0 Karma

Path Finder

I am having the exact same issue! did you figure out a solution?

0 Karma
Get Updates on the Splunk Community!

Admin Your Splunk Cloud, Your Way

Join us to maximize different techniques to best tune Splunk Cloud. In this Tech Enablement, you will get ...

Cloud Platform | Discontinuing support for TLS version 1.0 and 1.1

Overview Transport Layer Security (TLS) is a security communications protocol that lets two computers, ...

New Customer Testimonials

Enterprises of all sizes and across different industries are accelerating cloud adoption by migrating ...