Getting Data In

Hunk - SimpleCSVRecordReader

tt1
Explorer

Hi,

I have been recommended the SimpleCSVRecordReader to convert CSV to JSON.

I have tried to set up a Virtual Index Provider, but taking the default settings, but including the following line;

vix.splunk.search.recordreader com.splunk.mr.input.SimpleCSVRecordReader

When I try to use this against a file containing csv data it returns no results, yet by reseting the above line to default it returns results.

Any help appreciated.

Tags (3)
0 Karma
1 Solution

Ledion_Bitincka
Splunk Employee
Splunk Employee

Was that a typo or did you properly set the record reader as follows?

vix.splunk.search.recordreader = com.splunk.mr.input.SimpleCSVRecordReader

View solution in original post

Ledion_Bitincka
Splunk Employee
Splunk Employee

Was that a typo or did you properly set the record reader as follows?

vix.splunk.search.recordreader = com.splunk.mr.input.SimpleCSVRecordReader

tt1
Explorer

Ledion, many thanks for your help, you reminding me of the search.log helped. After checking that and googling the error in that log, I found an answer suggesting that I had chosen the incorrect version of Hadoop in my provider settings.

Selecting the correct version has solved the problem.

Thanks again for answering.

0 Karma

Ledion_Bitincka
Splunk Employee
Splunk Employee

The SimpleCSVRecordReader will only recognize certain file extension by default, you can override the default by setting

vix.splunk.search.recordreader.csv.regex

If that doesn't work, it would be great if you provide a link to the contents of search.log for your search so I can help troubleshoot the issue further

0 Karma

tt1
Explorer

Thanks for answering.

Yes using the web interface I have set vix.splunk.search.recordreader to com.splunk.mr.input.SimpleCSVRecordReader

Also tried

com.splunk.mr.input.SimpleCSVRecordReader, com.splunk.mr.input.ValueAvroRecordReader

as per this link

http://blogs.splunk.com/2013/09/27/hunk-setup-using-hortonworks-hadoop-sandbox/

not a lot out there on this subject.

0 Karma
Get Updates on the Splunk Community!

Celebrate CX Day with Splunk: Take our interactive quiz, join our LinkedIn Live ...

Today and every day, Splunk celebrates the importance of customer experience throughout our product, ...

How to Get Started with Splunk Data Management Pipeline Builders (Edge Processor & ...

If you want to gain full control over your growing data volumes, check out Splunk’s Data Management pipeline ...

Out of the Box to Up And Running - Streamlined Observability for Your Cloud ...

  Tech Talk Streamlined Observability for Your Cloud Environment Register    Out of the Box to Up And Running ...