Getting Data In

How to avoid duplicated event

Path Finder

We have csv type of data file which is overwritten and with new data appended to the end every night. I found Splunk load/duplicate all the data again everyday!

As I know crcSalt only check CRC with first few lines of the file. How Splunk works in this case to identify only end of the file has new data?

followTail works for file replace?

Tags (3)
0 Karma


How are you loading the file:

Are you using a Splunk monitor?

That might be your problem.

0 Karma

Path Finder

I am having the exact same issue! did you figure out a solution?

0 Karma
Get Updates on the Splunk Community!

Dashboard Studio Challenge - Learn New Tricks, Showcase Your Skills, and Win Prizes!

Reimagine what you can do with your dashboards. Dashboard Studio is Splunk’s newest dashboard builder to ...

Introducing Edge Processor: Next Gen Data Transformation

We get it - not only can it take a lot of time, money and resources to get data into Splunk, but it also takes ...

Take the 2021 Splunk Career Survey for $50 in Amazon Cash

Help us learn about how Splunk has impacted your career by taking the 2021 Splunk Career Survey. Last year’s ...