All Apps and Add-ons

Splunk Analytics for Hadoop: Why doesn't my search job finish and displays "Failed to start MapReduce job" error?

jmallorquin
Builder

Hi,

I have an issue: If i search for a virtual index, the search head starts to show events but stops when it has matched 36M.
If i count the events of the two file logs that we are searching, the total lines are 66M (no filters are set).

When the query finishes, the error shows this message:

[pruebas] Exception - com.splunk.mr.JobStartException: Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_Cloudera04_1480957020.4_0 ] and [ Call From Cloudera04/172.20.1.235 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused ]

Any advice?

Thanks in advance.

0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

View solution in original post

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

0 Karma

jmallorquin
Builder

Perfect it was the problem.

Thanks 🙂

0 Karma

jmallorquin
Builder

Hi rdagan

Now i have this problem can you giveme any advice?
https://answers.splunk.com/answers/479809/hunk-after-configure-yarn-variables-query-doesnt-f.html

regards

0 Karma
Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...