Getting Data In

error during csv index extraction

Communicator

I have setup a process where a heavy forwarder is ingesting a large number of csv files and the process seems to be working, but I am seeing the following error message for every single csv file

08-26-2016 08:41:19.386 -0500 WARN CsvLineBreaker - CSV StreamId: 2416848287927153596 has empty line. - datasource="/shared/storageperformance/storage/Hitachi/xxxxx/PhyLDEVdat/xxxxx82620160746PHYLongLDEV1-70.csv", datahost="xxxxx", datasourcetype="hitachi_perf"

Any idea what this means? I do see a blank line at the end of each CSV file. The data is being extracted as desired and the only issue I see other than the error message is the process is not very fast.

I am using 6.3.3

inputs.conf

[batch:///shared/storageperformance/storage/Hitachi]
disabled = false
host
segment = 5
index = storage
sourcetype = hitachiperf
move
policy = sinkhole
crcSalt =
recursive = true
whitelist = .csv$

props.conf

[hitachiperf]
category = Custom
description = Corp Hitachi Performance Data
pulldown
type = 1
DATETIMECONFIG =
INDEXED
EXTRACTIONS = csv
KVMODE = none
NO
BINARYCHECK = true
SHOULD
LINEMERGE = false
TZ = GMT
disabled = false

Thanks in advance!

0 Karma
1 Solution

Communicator

That error is merely telling you that it found a blank line within the CSV file. Notice it is just a WARN. It appears the file is still importing without issue. I think you can safely ignore these warnings.

View solution in original post

0 Karma

Communicator

That error is merely telling you that it found a blank line within the CSV file. Notice it is just a WARN. It appears the file is still importing without issue. I think you can safely ignore these warnings.

View solution in original post

0 Karma

Communicator

ok - what I was thinking but nice to get some confirmation.

0 Karma

Explorer

Is it possible to suppress the error per-sourcetype so as not to clutter the logs?

0 Karma