Archive
Highlighted

After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

Path Finder

I recently set up a Hortonworks Sandbox 2.1 in VirtualBox and installed Hunk 6.2 for some lab testing.
As the heading already says, when I start a search, it won't finalize. Hunk tells me x of y events matched and then gets stuck.
I configured my provider according to what Hue and the yarn-site.xml told me and none of the previous questions referring to the same issue helped me.
My search.log gives me 2 errors, I don't understand:

 1. java.lang.RuntimeException: Parent search is done. Alive token file does not exist: /opt/hunk/var/run/splunk/dispatch/subsearch_1422460645.44_1422461000.3/alive.token
 2. java.lang.RuntimeException: Parent search is done. Found file: /opt/hunk/var/run/splunk/dispatch/1422460645.44/finalize

http://pastebin.com/Ys93VTYL

Tags (3)
0 Karma
Highlighted

Re: After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

View solution in original post

Highlighted

Re: After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

Path Finder

I already figured it out this morning, when suddenly a "OutOfMemory" exception appeared instead which was way more helpful. Allocating more memory by modifying yarn-site.xml and mapred-site.xml solved the problem.