All Apps and Add-ons

Failed to start MapReduce job. Please consult search.log

Ledion_Bitincka
Splunk Employee
Splunk Employee

Running into an issue with Hunk against our Kerberized, YARN cluster. The Hunk principal auth works fine, what ends up happening is that a search will kick off, start searching thru events returns some results and previews: but after running over ~1 minute, it dies with:

01-27-2014 18:56:39.021 ERROR ERP.redacted-provider -  UserGroupInformation - PriviledgedActionException 
as:hunk@REDACTED.COM (auth:KERBEROS) cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Server not found in Kerberos database (7) - UNKNOWN_SERVER)]

the following error message is thrown in the UI too

[redacted-provider] JobStartException - Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_search1.dev.hunk.redacted.com_1390848963.3_0 ] and [ null ]

Any pointers would be appreciated

Tags (3)
0 Karma
1 Solution

Ledion_Bitincka
Splunk Employee
Splunk Employee

The root cause of the above problem was a typo in the service principal specification for the resourcemananager principal

vix.yarn.resourcemanager.principal = yarn/namenode.redacted.com@REDACTED.COM

a change to the generic/wildcard principal specification fixed the issue

vix.yarn.resourcemanager.principal = yarn/_HOST@REDACTED.COM

View solution in original post

0 Karma

Ledion_Bitincka
Splunk Employee
Splunk Employee

The root cause of the above problem was a typo in the service principal specification for the resourcemananager principal

vix.yarn.resourcemanager.principal = yarn/namenode.redacted.com@REDACTED.COM

a change to the generic/wildcard principal specification fixed the issue

vix.yarn.resourcemanager.principal = yarn/_HOST@REDACTED.COM
0 Karma
Get Updates on the Splunk Community!

Monitoring Postgres with OpenTelemetry

Behind every business-critical application, you’ll find databases. These behind-the-scenes stores power ...

Mastering Synthetic Browser Testing: Pro Tips to Keep Your Web App Running Smoothly

To start, if you're new to synthetic monitoring, I recommend exploring this synthetic monitoring overview. In ...

Splunk Edge Processor | Popular Use Cases to Get Started with Edge Processor

Splunk Edge Processor offers more efficient, flexible data transformation – helping you reduce noise, control ...