Getting Data In

Support CSV files that have no CRLF at end of last line?

wryanthomas
Contributor

In the TA documentation at https://splunk.github.io/splunk-add-on-for-amazon-web-services/S3/ -- it is stated, "Ensure that all files have a carriage return at the end of each file. Otherwise, the last line of the CSV file will not be indexed."  But the CSV standard (https://www.ietf.org/rfc/rfc4180.txt) does not require a CRLF at end of last row.  Can you please remedy this so a standard-compliant CSV file without a final CRLF still works and ingests the final row?  Some source solutions only output CSV files in this way (without final CRLF).

Labels (1)
0 Karma

PickleRick
SplunkTrust
SplunkTrust

Mind you this RFC is informational and only aims to document common practices. It's by no means to be a standard.

0 Karma

wryanthomas
Contributor

Thanks.  I see that RFC 4108 specifies the same thing -- that the last line could end with or without a final CRLF:

https://www.loc.gov/preservation/digital/formats/fdd/fdd000323.shtml

In the Notes, General section at the end of the document, "The last record in a file may or may not end with a line break character."

 

0 Karma

wryanthomas
Contributor

Thanks.  I have submitted it as an idea at ideas.splunk.com.  https://ideas.splunk.com/ideas/APPSID-I-944

0 Karma

isoutamo
SplunkTrust
SplunkTrust
If you want this kind of feature into this TA, you must ask it from splunk support and/or ideas.splunk.com.
0 Karma
Get Updates on the Splunk Community!

Index This | What is broken 80% of the time by February?

December 2025 Edition   Hayyy Splunk Education Enthusiasts and the Eternally Curious!    We’re back with this ...

Unlock Faster Time-to-Value on Edge and Ingest Processor with New SPL2 Pipeline ...

Hello Splunk Community,   We're thrilled to share an exciting update that will help you manage your data more ...

Splunk MCP & Agentic AI: Machine Data Without Limits

Discover how the Splunk Model Context Protocol (MCP) Server can revolutionize the way your organization uses ...