Getting Data In

Data collection not working- What should I check for collection of csv file data?

hhhwang
Explorer

Intermittent text file data collection is not possible.

Initially, it is a collection of csv file data.

After that, if you change only a few characters in the csv, you cannot collect them intermittently.

Which part should I check?

 

- setting

[monitor://D:\Space\Config*File\Devicenet_Config.csv]
disabled = 0
host = HOST_NAME
index = FDC_MainUtility
sourcetype = FDCField
crcSalt = <SOURCE>

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

What you describe sounds normal.  Splunk will not necessarily notice arbitrary character changes in a file.  If it does notice then it will re-index the entire file - possibly resulting in duplicate data.  Splunk expects new data to be written to the end of the file.

---
If this reply helps you, Karma would be appreciated.
Get Updates on the Splunk Community!

Mastering Data Pipelines: Unlocking Value with Splunk

 In today's AI-driven world, organizations must balance the challenges of managing the explosion of data with ...

The Latest Cisco Integrations With Splunk Platform!

Join us for an exciting tech talk where we’ll explore the latest integrations in Cisco &#43; Splunk! We’ve ...

AI Adoption Hub Launch | Curated Resources to Get Started with AI in Splunk

Hey Splunk Practitioners and AI Enthusiasts! It’s no secret (or surprise) that AI is at the forefront of ...