Getting Data In

Data collection not working- What should I check for collection of csv file data?

hhhwang
Explorer

Intermittent text file data collection is not possible.

Initially, it is a collection of csv file data.

After that, if you change only a few characters in the csv, you cannot collect them intermittently.

Which part should I check?

 

- setting

[monitor://D:\Space\Config*File\Devicenet_Config.csv]
disabled = 0
host = HOST_NAME
index = FDC_MainUtility
sourcetype = FDCField
crcSalt = <SOURCE>

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Calling All Security Pros: Ready to Race Through Boston?

Hey Splunkers, .conf25 is heading to Boston and we’re kicking things off with something bold, competitive, and ...

Beyond Detection: How Splunk and Cisco Integrated Security Platforms Transform ...

Financial services organizations face an impossible equation: maintain 99.9% uptime for mission-critical ...

Customer success is front and center at .conf25

Hi Splunkers, If you are not able to be at .conf25 in person, you can still learn about all the latest news ...