Getting Data In

ERROR TailReader - Was unable to open file /path/to/app/string-eventlogfile-splunk.csv

sanjum
Loves-to-Learn Everything

Hi Splunk folks,

I am getting the above errors with in  my _internals logs. 
nothing implies to me from this post https://community.splunk.com/t5/Getting-Data-In/Getting-Error-from-TailReader/m-p/356760
I have checked that file exits on host but UF is unable to read and send to indexers.
I have checked permissions, the header is same for all the file, and there are plenty of resources on the host and this is the only app running on the host where UF is running.
we have distributed deployment.

here comes the weird part....we miss some data(files) for few days and then it works fine for few days... so when we find the files which are not being ingested to indexers from UF, we manually touch the file from backend(which change the time stamp) and then we get success. but there too many to touch and so time consuming.

props.conf

[salesforce_csv_input]
TZ = GMT
SHOULD_LINEMERGE = false
TRUNCATE = 60000
pulldown_type = true
INDEXED_EXTRACTIONS = csv
CHECK_FOR_HEADER = true
KV_MODE = none
category = Structured
NO_BINARY_CHECK = true
FIELDALIAS.....
FIELDALIAS.....
FIELDALIAS....
FIELDALIAS.....
FIELDALIAS.....
FIELDALIAS...

inputs.conf

[monitor:///path/to/app/*-eventlogfile-splunk.csv]
index = salesforce
sourcetype = salesforce_csv_input
disabled = 0
initCrcLength = 1024

Labels (4)
0 Karma

sanjum
Loves-to-Learn Everything

when we are missing data usually there is peak on warnings like this.
02-20-2021
01:59:49.493 -0500 WARN TcpOutputProc - Cooked connection to ip=###########:9996 timed out

0 Karma
Get Updates on the Splunk Community!

Leveraging Detections from the Splunk Threat Research Team & Cisco Talos

  Now On Demand  Stay ahead of today’s evolving threats with the combined power of the Splunk Threat Research ...

New in Splunk Observability Cloud: Automated Archiving for Unused Metrics

Automated Archival is a new capability within Metrics Management; which is a robust usage & cost optimization ...

Calling All Security Pros: Ready to Race Through Boston?

Hey Splunkers, .conf25 is heading to Boston and we’re kicking things off with something bold, competitive, and ...