Getting Data In

Data collection not working- What should I check for collection of csv file data?

hhhwang
Explorer

Intermittent text file data collection is not possible.

Initially, it is a collection of csv file data.

After that, if you change only a few characters in the csv, you cannot collect them intermittently.

Which part should I check?

 

- setting

[monitor://D:\Space\Config*File\Devicenet_Config.csv]
disabled = 0
host = HOST_NAME
index = FDC_MainUtility
sourcetype = FDCField
crcSalt = <SOURCE>

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Community Feedback

We Want to Hear from You! Share Your Feedback on the Splunk Community   The Splunk Community is built for you ...

Manual Instrumentation with Splunk Observability Cloud: Implementing the ...

In our observability journey so far, we've built comprehensive instrumentation for our Worms in Space ...