All Apps and Add-ons

Splunk Analytics for Hadoop: Why doesn't my search job finish and displays "Failed to start MapReduce job" error?

jmallorquin
Builder

Hi,

I have an issue: If i search for a virtual index, the search head starts to show events but stops when it has matched 36M.
If i count the events of the two file logs that we are searching, the total lines are 66M (no filters are set).

When the query finishes, the error shows this message:

[pruebas] Exception - com.splunk.mr.JobStartException: Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_Cloudera04_1480957020.4_0 ] and [ Call From Cloudera04/172.20.1.235 to 0.0.0.0:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused ]

Any advice?

Thanks in advance.

0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

View solution in original post

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

It looks like the flag: yarn.resourcemanager.address is pointing to the wrong IP
In the docs see this section: http://docs.splunk.com/Documentation/Splunk/6.5.1/HadoopAnalytics/RequiredConfigurationVariablesforY...

0 Karma

jmallorquin
Builder

Perfect it was the problem.

Thanks 🙂

0 Karma

jmallorquin
Builder

Hi rdagan

Now i have this problem can you giveme any advice?
https://answers.splunk.com/answers/479809/hunk-after-configure-yarn-variables-query-doesnt-f.html

regards

0 Karma
Get Updates on the Splunk Community!

.conf23 | Get Your Cybersecurity Defense Analyst Certification in Vegas

We’re excited to announce a new Splunk certification exam being released at .conf23! If you’re going to Las ...

Starting With Observability: OpenTelemetry Best Practices

Tech Talk Starting With Observability: OpenTelemetry Best Practices Tuesday, October 17, 2023   |  11AM PST / ...

Streamline Data Ingestion With Deployment Server Essentials

REGISTER NOW! Every day the list of sources Admins are responsible for gets bigger and bigger, often making ...