All Apps and Add-ons

Splunk Analytics for Hadoop: Why doesn't my search job finish and displays "Failed to start MapReduce job" error?

jmallorquin
Builder

Hi,

I have an issue: If i search for a virtual index, the search head starts to show events but stops when it has matched 36M.
If i count the events of the two file logs that we are searching, the total lines are 66M (no filters are set).

When the query finishes, the error shows this message:

[pruebas] Exception - com.splunk.mr.JobStartException: Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_Cloudera04_1480957020.4_0 ] and [ Call From Cloudera04/172.20.1.235 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused ]

Any advice?

Thanks in advance.

0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

View solution in original post

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

0 Karma

jmallorquin
Builder

Perfect it was the problem.

Thanks 🙂

0 Karma

jmallorquin
Builder

Hi rdagan

Now i have this problem can you giveme any advice?
https://answers.splunk.com/answers/479809/hunk-after-configure-yarn-variables-query-doesnt-f.html

regards

0 Karma
Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...