All Apps and Add-ons

After setting up Hortonworks Sandbox 2.1 and installing Hunk 6.2, why are Hunk jobs not getting finalized (YARN HDP 2.x)?

hRun
Path Finder

I recently set up a Hortonworks Sandbox 2.1 in VirtualBox and installed Hunk 6.2 for some lab testing.
As the heading already says, when I start a search, it won't finalize. Hunk tells me x of y events matched and then gets stuck.
I configured my provider according to what Hue and the yarn-site.xml told me and none of the previous questions referring to the same issue helped me.
My search.log gives me 2 errors, I don't understand:

 1. java.lang.RuntimeException: Parent search is done. Alive token file does not exist: /opt/hunk/var/run/splunk/dispatch/subsearch_1422460645.44_1422461000.3/alive.token
 2. java.lang.RuntimeException: Parent search is done. Found file: /opt/hunk/var/run/splunk/dispatch/1422460645.44/finalize

http://pastebin.com/Ys93VTYL

Tags (3)
0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

View solution in original post

rdagan_splunk
Splunk Employee
Splunk Employee

You maybe seeing the same memory issues we saw with this earlier version of Hortonworks sandbox:
http://answers.splunk.com/answers/113972/issue-with-hortonworks-yarn-sandbox-hdp-2-and-hunk.html

hRun
Path Finder

I already figured it out this morning, when suddenly a "OutOfMemory" exception appeared instead which was way more helpful. Allocating more memory by modifying yarn-site.xml and mapred-site.xml solved the problem.

Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...