Hi,
When setting up the Virtual Indexes -> provider for Hunk, I am a bit confused about the configuration options.
Hadoop version: Hadoop 2.x Yarn
Job tracker (-> ? In 2 there is not Job Tracker... I used the Resource Manager)
master1:8032
File system
hdfs://master1:8020
Then added the following two settings:
vix.mapreduce.framework.name=yarn
vix.yarn.resourcemanager.address=master1:8032
vix.yarn.resourcemanager.scheduler.address=master1:8030
Those values match with the yarn-site.xml
<property>
<name>yarn.resourcemanager.address</name>
<value>master1:8032</value>
</property>
<property>
<name>yarn.resourcemanager.admin.address</name>
<value>master1:8033</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>master1:8030</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>master1:8031</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>master1:8088</value>
</property>
Which generates the following error:
[Stor] JobStartException - Failed to start MapReduce job. Please consult search.log for more information. Message: [ Failed to start MapReduce job, name=SPLK_master1_1389788887.59_0 ] and [ Unknown rpc kind RPC_WRITABLE ]
If I enable MapReduce v1, and set the address of the JobTracker in the "Job Tracker" field:
master1:8021
Then it works but uses MR v1 and not YARN.
What am I missing?
... View more
