Getting Data In

Support CSV files that have no CRLF at end of last line?

wryanthomas
Contributor

In the TA documentation at https://splunk.github.io/splunk-add-on-for-amazon-web-services/S3/ -- it is stated, "Ensure that all files have a carriage return at the end of each file. Otherwise, the last line of the CSV file will not be indexed."  But the CSV standard (https://www.ietf.org/rfc/rfc4180.txt) does not require a CRLF at end of last row.  Can you please remedy this so a standard-compliant CSV file without a final CRLF still works and ingests the final row?  Some source solutions only output CSV files in this way (without final CRLF).

Labels (1)
0 Karma

PickleRick
SplunkTrust
SplunkTrust

Mind you this RFC is informational and only aims to document common practices. It's by no means to be a standard.

0 Karma

wryanthomas
Contributor

Thanks.  I see that RFC 4108 specifies the same thing -- that the last line could end with or without a final CRLF:

https://www.loc.gov/preservation/digital/formats/fdd/fdd000323.shtml

In the Notes, General section at the end of the document, "The last record in a file may or may not end with a line break character."

 

0 Karma

wryanthomas
Contributor

Thanks.  I have submitted it as an idea at ideas.splunk.com.  https://ideas.splunk.com/ideas/APPSID-I-944

0 Karma

isoutamo
SplunkTrust
SplunkTrust
If you want this kind of feature into this TA, you must ask it from splunk support and/or ideas.splunk.com.
0 Karma
Get Updates on the Splunk Community!

Data Management Digest – December 2025

Welcome to the December edition of Data Management Digest! As we continue our journey of data innovation, the ...

Index This | What is broken 80% of the time by February?

December 2025 Edition   Hayyy Splunk Education Enthusiasts and the Eternally Curious!    We’re back with this ...

Unlock Faster Time-to-Value on Edge and Ingest Processor with New SPL2 Pipeline ...

Hello Splunk Community,   We're thrilled to share an exciting update that will help you manage your data more ...