Getting Data In

AWS S3 Input- Ingest .csv files that are not actually csv formatted- Is there a way to turn off CSV parsing ability?

ehudb
Contributor

We have a new Splunk Cloud environment

We are using AWS TA Add On to ingest files from S3

The files have extension of ".csv" but they are not really CSV, they are TSV (tab separated values).

The Add-On has built-in functionality to inspect CSV files and tried to convert them to json, therefore it fails to ingest them correctly.

Is there any way to turn-off the CSV parsing ability of the S3 input?

Source:
https://docs.splunk.com/Documentation/AddOns/released/AWS/S3

"The Generic S3 custom data types input ...

Labels (1)
Tags (3)
0 Karma

mmwilson0
Explorer

Try adding to your input:

parse_csv_with_header=0

 

0 Karma
Get Updates on the Splunk Community!

Enterprise Security Content Update (ESCU) | New Releases

In December, the Splunk Threat Research Team had 1 release of new security content via the Enterprise Security ...

Why am I not seeing the finding in Splunk Enterprise Security Analyst Queue?

(This is the first of a series of 2 blogs). Splunk Enterprise Security is a fantastic tool that offers robust ...

Index This | What are the 12 Days of Splunk-mas?

December 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...