topic Re: Hunk Tutorial - No Results Found in All Apps and Add-ons

Hunk Tutorial - No Results Found

fblau — Mon, 28 Sep 2020 16:05:23 GMT

I am getting this error in Hunk:

03-11-2014 08:45:08.354 ERROR SearchOperator:stdin - Cannot consume data with unset stream_type
03-11-2014 08:45:08.355 ERROR ResultProvider - Error in 'SearchOperator:stdin': Cannot consume data with unset stream_type

And no results are returning.

This is using the Hunk Tutorial settings.

Re: Hunk Tutorial - No Results Found

nhaddadkaveh_sp — Tue, 11 Mar 2014 16:41:14 GMT

Can you copy your indexes.conf in here. What version of Hadoop are you using?

Re: Hunk Tutorial - No Results Found

fblau — Mon, 28 Sep 2020 16:05:26 GMT

I am using the Cloudera Quickstart VM.
There are several indexes.conf files... which one do you want?
/home/cloudera/splunk/etc/apps/sample_app/default/indexes.conf
/home/cloudera/splunk/etc/apps/SplunkLightForwarder/default/indexes.conf
/home/cloudera/splunk/etc/apps/search/local/indexes.conf
/home/cloudera/splunk/etc/system/default/indexes.conf
/home/cloudera/splunk/etc/master-apps/_cluster/default/indexes.conf

Re: Hunk Tutorial - No Results Found

nhaddadkaveh_sp — Tue, 11 Mar 2014 17:15:44 GMT

I need to see your provider and virtual indexes. I am guessing this one:
/home/cloudera/splunk/etc/apps/search/local/indexes.conf (if you haven't moved it under your App)

Re: Hunk Tutorial - No Results Found

fblau — Mon, 28 Sep 2020 16:05:29 GMT

Here you go:

[provider:PonyProvider]
vix.env.HADOOP_HOME = /usr/lib/hadoop
vix.env.JAVA_HOME = /usr/java/jdk1.6.0_32
vix.family = hadoop
vix.fs.default.name = hdfs://localhost/8020
vix.mapred.job.tracker = localhost:8021
vix.splunk.home.hdfs = /user/root/splunkmr

[ponyindex]
vix.input.1.accept = .gz$
vix.input.1.path = /data/...
vix.provider = PonyProvider

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 17:23:30 GMT

ps: there is a backslash before the .gz that somehow this webpage doesn't show.

Re: Hunk Tutorial - No Results Found

nhaddadkaveh_sp — Tue, 11 Mar 2014 17:33:57 GMT

You need to change vix.fs.default.name = hdfs://localhost/8020 to vix.fs.default.name = hdfs://localhost:8020
And make sure you have your data in hdfs under /data

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 17:36:24 GMT

Can you clarify that? Those are the same 🙂

Re: Hunk Tutorial - No Results Found

nhaddadkaveh_sp — Tue, 11 Mar 2014 17:38:46 GMT

you have a slash before 8020 but you need colon (:8020)

Re: Hunk Tutorial - No Results Found

fblau — Mon, 28 Sep 2020 16:05:33 GMT

[ponyindex]
vix.input.1.accept = .gz$
vix.input.1.path = /data/...
vix.provider = PonyProvider
[cloudera@localhost local]$ cat indexes.conf
[provider:PonyProvider]
vix.env.HADOOP_HOME = /usr/lib/hadoop
vix.env.JAVA_HOME = /usr/java/jdk1.6.0_32
vix.family = hadoop
vix.fs.default.name = hdfs://localhost:8020
vix.mapred.job.tracker = localhost:8021
vix.splunk.home.hdfs = /user/root/splunkmr

[ponyindex]
vix.input.1.accept = .gz$
vix.input.1.path = /data/...
vix.provider = PonyProvider

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 17:41:39 GMT

Changed that. Still getting the same error.

Re: Hunk Tutorial - No Results Found

nhaddadkaveh_sp — Tue, 11 Mar 2014 17:43:03 GMT

Please paste your search.log in here

Re: Hunk Tutorial - No Results Found

fblau — Mon, 28 Sep 2020 16:05:38 GMT

file is too large to post. Here is the error section:

03-11-2014 10:43:04.242 ERROR SearchOperator:stdin - Cannot consume data with unset stream_type
03-11-2014 10:43:04.242 ERROR ResultProvider - Error in 'SearchOperator:stdin': Cannot consume data with unset stream_type
0

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 18:08:36 GMT

http://pastebin.com/TvajmRZM

Re: Hunk Tutorial - No Results Found

apatil_splunk — Tue, 11 Mar 2014 18:21:47 GMT

Can you please check what hadoop version you selected while creating the Provider on UI.
In the drop down Hadoop version is this selected Hadoop 2.x,(MRv1) ?

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 18:24:14 GMT

1.x is selected currently

Re: Hunk Tutorial - No Results Found

fblau — Tue, 11 Mar 2014 18:25:09 GMT

BINGO! Changing it to 2.x worked!