While trying to configure hadoop connectivity to splunk hadoop app, we see the following error:
Invalid Hadoop CLI command path /usr/local/hadoop/hadoop-0.20.2/bin/hadoop
How to configure splunk which user to use logging into the hadoop server. Hadoop server in our environment runs as user "hadoop". We have shared the ssh keys between the splunk and hadoop server, we are still getting the above error message.
In other words, under "dd new HDFS Cluster" in splunk what value should be provided for HADOOP_HOME?
Just to double check - this is for Splunk App for HadoopOps and NOT Hadoop Connect?
Unfortunately, there's no way to configure which user will run those Hadoop Commands. It will run as the Splunk user, just as most other scripts do.
Judging by the error, it looks like you haven't installed the CLI commands onto the system that is running Hadoop Connect.
Please check out the documentation here - http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/HadoopCLI
You have to install the CLI on the Splunk instance you are running Hadoop Connect because it connects remotely to the HDFS file system.