topic Re: How do you properly upload CSV data to Splunk? in Splunk Enterprise Security

How do you properly upload CSV data to Splunk?

krhines410 — Wed, 05 Sep 2018 04:22:23 GMT

I am trying to be an admin for a separate work project. But our original admin has been out of town for a few weeks, so I am unable to ask him before my deadline. I was trying to get this sample project done..

I have TXT file logs that I transfer over to Excel CSV sheets, and i use the first line as the field names, and the columns for each field have a flow of data.

When I upload the the CSV to Splunk, all I am getting is a 100% bar but it is gray. When I upload the sample logs from Splunk, the bar goes green.

Do you have any tips on making the data acceptable. My Excel sheet looks almost identical to Splunk's sample sheets but my data does not confirm with a green bar.

Any suggestions?

Re: How do you properly upload CSV data to Splunk?

adonio — Sat, 08 Sep 2018 11:09:55 GMT

Splunk Can Not index Excel files as those contain binary (propitiatory formatted) data.
save your files as .csv and enjoy Splunk power

Re: How do you properly upload CSV data to Splunk?

mstjohn_splunk — Tue, 11 Sep 2018 18:26:18 GMT

hi @krhines410,

Did the answer below solve your problem? If so, please resolve this post by approving it!

If your problem is still not solved, keep us updated so that someone else can help ya.

Thanks for posting!

Re: How do you properly upload CSV data to Splunk?

felipesewaybric — Sun, 16 Sep 2018 21:34:56 GMT

Have you try the untable command?

Re: How do you properly upload CSV data to Splunk?

MonkeyK — Sun, 16 Sep 2018 22:15:55 GMT

Adonio has an excellent answer. I would also recommend the lookup editor app on SplunkBase. Lets you cut and paste from a spreadsheet with automatic insertion of new lines.

Re: How do you properly upload CSV data to Splunk?

woodcock — Sun, 16 Sep 2018 23:59:15 GMT

Make sure that you do Save As in Excel and select DOS CSV or Windows CSV or even plain text. Then open the file with Notepad++ and make sure that it looks the way that it should. Then upload this version if the file.

Re: How do you properly upload CSV data to Splunk?

kamlesh_vaghela — Mon, 17 Sep 2018 02:04:36 GMT

First, save as your excel file in CSV file and then open it into notepad++ or any text editor to verify it. If your data having a comma as a value then make sure you need to select different separator as csv data separator, like pipe.

After creating proper csv file upload into splunk

Re: How do you properly upload CSV data to Splunk?

Noah_Woodcock — Mon, 17 Sep 2018 02:21:19 GMT

Blog post

This blog post has good information!

Re: How do you properly upload CSV data to Splunk?

krhines410 — Mon, 17 Sep 2018 03:17:25 GMT

I converted a txt document to an excel spreadsheet and saved it as .csv. inside excel.

The downloaded test data that Splunk provides is Excel .csv

When you upload my document the percentage bar will go to a 100% but it is grayed.

When you upload Splunks excel sheet it goes 100% green.

Is it due to the fact that they are in zipped csv files?

Re: How do you properly upload CSV data to Splunk?

krhines410 — Mon, 17 Sep 2018 03:18:59 GMT

I did do that and its very useful.

But i was still trying to resolve my initial issue. Where my CSV files will not upload to Splunk.. it is frustrating

Re: How do you properly upload CSV data to Splunk?

krhines410 — Mon, 17 Sep 2018 03:19:32 GMT

Was not aware that I should do Notepad++ going to be looking into that..

Thank you

Re: How do you properly upload CSV data to Splunk?

woodcock — Wed, 19 Sep 2018 22:26:42 GMT

I have had problems with the way that Notepad handles newlines on Windows for Splunk files. I have never had any problems with Notepad++. I actually use vi and mobaxterm.

Re: How do you properly upload CSV data to Splunk?

woodcock — Wed, 19 Sep 2018 22:27:52 GMT

I think you have a problem with your links; I only see a google search, @noah_woodcock.