Splunk Search

I have downloaded Hunk VM (hunk-6.2-237464-Linux-x86_64.tgz) but unable to access local hadoop to test sample data

pfurlani
Explorer

I have built the Virtual Box vm with hunk-6.2-237464-Linux-x86_64.tgz and followed the tutorial.
I would like to add some sample data to the local hadoop to test real case scenarios... how do I do that?
I am unable to run any "hdfs dfs -put ..." command to add data to the cluster... however I can see the data used in the tutorial through the web interface.

Paolo.

0 Karma
1 Solution

pfurlani
Explorer

I managed to connect to root on the Hunk 6.2 sandbox, however still having problems accessing the local hadoop environment:
...
root@hunk-VirtualBox:~# jps
2716 ResourceManager
9772 Jps
2526 SecondaryNameNode
2148 DataNode
2942 NodeManager
root@hunk-VirtualBox:~# hadoop fs -ls /
14/12/04 14:01:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: Call From hunk-VirtualBox/127.0.1.1 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

Please help, I would like to explore Hunk with my sample data.

Thanks,
Paolo.

View solution in original post

0 Karma

pfurlani
Explorer

I managed to connect to root on the Hunk 6.2 sandbox, however still having problems accessing the local hadoop environment:
...
root@hunk-VirtualBox:~# jps
2716 ResourceManager
9772 Jps
2526 SecondaryNameNode
2148 DataNode
2942 NodeManager
root@hunk-VirtualBox:~# hadoop fs -ls /
14/12/04 14:01:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: Call From hunk-VirtualBox/127.0.1.1 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

Please help, I would like to explore Hunk with my sample data.

Thanks,
Paolo.

0 Karma

pfurlani
Explorer

Somehow the vm was corrupted... I have re-downloaded and now it works.
Thanks for the help nhaddadkaveh.

Paolo.

0 Karma

nhaddadkaveh_sp
Splunk Employee
Splunk Employee

I would suggest stop all Hadoop process and start them again by running the following commands as root:

/etc/init.d/hadoop-master stop

/etc/init.d/hadoop-master start

If this didn't help I would suggest to download the sandbox again since the current one may have been corrupted.

0 Karma

nhaddadkaveh_sp
Splunk Employee
Splunk Employee

I am assuming you have download the Hunk sandbox (hunk sandbox 6.2.ova) from the website. If that is the case you need to be user "root" in order to add data into HDFS. The password is "hunkadmin".

0 Karma

nhaddadkaveh_sp
Splunk Employee
Splunk Employee

When you login to the sandbox the default user is "hunk". You need to change it to "root" as I mentioned by:

$ su -
password:hunkadmin

When you are root, type:

jps

to make sure the expected Hadoop processes are running. If Hadoop is not running you can type the following to start Hadoop:

/etc/init.d/hadoop-master start

After that you can type either of these two to access to your data:

hadoop fs -ls /

hdfs dfs -ls /

0 Karma

pfurlani
Explorer

Hi there, thanks for the answer... however that password doesn't work for me.
I managed to get to root with "sudo su -" from the hank user session in the terminal...
however when I execute (with root) something like "hdfs dfs -ls /" I got errors like "Unable to load native-hadoop library..." "Connection refused..."
Any idea why?

Thanks for the help.
Paolo.

0 Karma
Get Updates on the Splunk Community!

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...