Getting Data In

Data collection not working- What should I check for collection of csv file data?

hhhwang
Explorer

Intermittent text file data collection is not possible.

Initially, it is a collection of csv file data.

After that, if you change only a few characters in the csv, you cannot collect them intermittently.

Which part should I check?

 

- setting

[monitor://D:\Space\Config*File\Devicenet_Config.csv]
disabled = 0
host = HOST_NAME
index = FDC_MainUtility
sourcetype = FDCField
crcSalt = <SOURCE>

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...

Cloud Monitoring Console - Unlocking Greater Visibility in SVC Usage Reporting

For Splunk Cloud customers, understanding and optimizing Splunk Virtual Compute (SVC) usage and resource ...

Automatic Discovery Part 3: Practical Use Cases

If you’ve enabled Automatic Discovery in your install of the Splunk Distribution of the OpenTelemetry ...