topic Re: Can you help me find or load main class org.apache.hadoop.fs.FsShell during configure Splunk Hadoop Connect application? in All Apps and Add-ons

Can you help me find or load main class org.apache.hadoop.fs.FsShell during configure Splunk Hadoop Connect application?

yko84109 — Tue, 29 Sep 2020 23:06:44 GMT

Hi,

I'm trying to configure the Splunk Hadoop Connect application with the following configurations:

HDFS URI: mynamenode:8020 HADOOP_HOME:
/opt/cloudera/parcels/CDH JAVA_HOME:
/usr/lib/jvm/java (tried also
/usr/java/latest) Namenode HTTP Port:
50070

And I'm got the following error:

Unable to connect to Hadoop cluster 'hdfs://mynamenode:8020/' with principal 'None': Failed to run Hadoop CLI job command '-ls' with options 'hdfs://mynamenode:8020/' Error: Could not find or load main class org.apache.hadoop.fs.FsShell.

How can I solve this?

Thanks!

Re: Can you help me find or load main class org.apache.hadoop.fs.FsShell during configure Splunk Hadoop Connect application?

rdagan_splunk — Thu, 07 Feb 2019 17:02:37 GMT

To debug this, from the command line, can you run the commands:
which hadoop
and
which java

Re: Can you help me find or load main class org.apache.hadoop.fs.FsShell during configure Splunk Hadoop Connect application?

yko84109 — Mon, 11 Feb 2019 08:07:29 GMT

Hi.
Thats wha't i'm doing, same error..

Re: Can you help me find or load main class org.apache.hadoop.fs.FsShell during configure Splunk Hadoop Connect application?

rdagan_splunk — Mon, 11 Feb 2019 17:16:37 GMT

As you can see from this video ( https://www.youtube.com/watch?v=TmYHsabpk_Q )
When you setup the Java path and Hadoop path inside Splunk Hadoop Connect, you should not include the ' bin/hadoop or bin/java part
Can you share the output of these ' which hadoop ' and ' which java ' commands?