All Apps and Add-ons

After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

hRun
Path Finder

I recently set up a Hortonworks Sandbox 2.1 in VirtualBox and installed Hunk 6.2 for some lab testing.
As the heading already says, when I start a search, it won't finalize. Hunk tells me x of y events matched and then gets stuck.
I configured my provider according to what Hue and the yarn-site.xml told me and none of the previous questions referring to the same issue helped me.
My search.log gives me 2 errors, I don't understand:

 1. java.lang.RuntimeException: Parent search is done. Alive token file does not exist: /opt/hunk/var/run/splunk/dispatch/subsearch_1422460645.44_1422461000.3/alive.token
 2. java.lang.RuntimeException: Parent search is done. Found file: /opt/hunk/var/run/splunk/dispatch/1422460645.44/finalize

http://pastebin.com/Ys93VTYL

Tags (3)
0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

View solution in original post

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

hRun
Path Finder

I already figured it out this morning, when suddenly a "OutOfMemory" exception appeared instead which was way more helpful. Allocating more memory by modifying yarn-site.xml and mapred-site.xml solved the problem.

Get Updates on the Splunk Community!

Enterprise Security Content Update (ESCU) | New Releases

In December, the Splunk Threat Research Team had 1 release of new security content via the Enterprise Security ...

Why am I not seeing the finding in Splunk Enterprise Security Analyst Queue?

(This is the first of a series of 2 blogs). Splunk Enterprise Security is a fantastic tool that offers robust ...

Index This | What are the 12 Days of Splunk-mas?

December 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...