About nhaddadkaveh_sp

nhaddadkaveh_sp · ‎12-17-2014

I would suggest stop all Hadoop process and start them again by running the following commands as root: /etc/init.d/hadoop-master stop /etc/init.d/hadoop-master start If this didn't help I would suggest to download the sandbox again since the current one may have been corrupted.

nhaddadkaveh_sp · ‎12-04-2014

When you login to the sandbox the default user is "hunk". You need to change it to "root" as I mentioned by: $ su - password:hunkadmin When you are root, type: jps to make sure the expected Hadoop processes are running. If Hadoop is not running you can type the following to start Hadoop: /etc/init.d/hadoop-master start After that you can type either of these two to access to your data: hadoop fs -ls / hdfs dfs -ls /

nhaddadkaveh_sp · ‎12-03-2014

I am assuming you have download the Hunk sandbox (hunk sandbox 6.2.ova) from the website. If that is the case you need to be user "root" in order to add data into HDFS. The password is "hunkadmin".

nhaddadkaveh_sp · ‎07-18-2014

You can select the Haoop version from the UI under "Provider" Also you need to add these in your indexes.conf: vix.mapred.job.tracker = jobtracker.hadoop.splunk.com:8021 vix.fs.default.name = hdfs://hdfs.hadoop.splunk.com:8020 vix.splunk.home.datanode = / For more detail you can check here: http://docs.splunk.com/Documentation/Hunk/6.1.1/Hunk/Setupavirtualindex

nhaddadkaveh_sp · ‎05-27-2014

If you want to run the same query over and over it is better to make it a saved search and accelerate that in Hunk 6.1

nhaddadkaveh_sp · ‎04-16-2014

No you won't lose any functionality. You can use almost all the SPL commands (except a few) and all the GUI features are the same in Hunk and Splunk.

nhaddadkaveh_sp · ‎03-11-2014

Please paste your search.log in here

nhaddadkaveh_sp · ‎03-11-2014

you have a slash before 8020 but you need colon (:8020)

nhaddadkaveh_sp · ‎03-11-2014

You need to change vix.fs.default.name = hdfs://localhost/8020 to vix.fs.default.name = hdfs://localhost:8020 And make sure you have your data in hdfs under /data

nhaddadkaveh_sp · ‎03-11-2014

I need to see your provider and virtual indexes. I am guessing this one: /home/cloudera/splunk/etc/apps/search/local/indexes.conf (if you haven't moved it under your App)

nhaddadkaveh_sp · ‎03-11-2014

Can you copy your indexes.conf in here. What version of Hadoop are you using?

nhaddadkaveh_sp · ‎03-04-2014

In order to work with Hadoop cluster you need to install Hunk not Splunk. Also we don't support Hunk on Windows.

nhaddadkaveh_sp · ‎03-04-2014

Vikas, HDP 2.0.6 is compatible with Hunk.

nhaddadkaveh_sp · ‎02-27-2014

If you just change vix.splunk.search.recordreader=com.splunk.mr.input.SimpleCSVRecordReader and remove vix.splunk.search.recordreader.csv.dialect = tsv, it should work. This converts single-line-record csv/tsv/excel files to json

nhaddadkaveh_sp · ‎02-14-2014

You can follow this instruction: http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/Downloadandinstalltheapp

nhaddadkaveh_sp · ‎02-04-2014

We will support Cassandra in our next releases of Hunk (Splunk on top of Hadoop) by the end of this year. Then you can point Hunk to Cassandra for your need.

nhaddadkaveh_sp · ‎12-05-2013

After a lot of investigation, it turned out this is a memory issue with Yarn. We expected by default Yarn has 8192 MB memory; however, it is set to 2048 in configuration file and that is why Mapreduce jobs will never end (it goes to idle mode). The worst part is that the error is not very helpful either. To fix this issue you need to allocate more memory to Yarn on the node by changing the following property in yarn-site.xml yarn.nodemanager.resource.memory-mb 5120 You need to make sure you have enough memory assigned to your sandbox. My sandbox has 8 gig of RAM and I assigned 5120 MB to Yarn.

nhaddadkaveh_sp · ‎12-05-2013

It seems that HDP 2 Sandbox from Hortonworks does not work as it is with Hunk running on it. The data preview stuff works perfectly fine but Hunk gives you error when you want to run Mapreduce jobs with the following error: Application application_1386035090053_0009 failed 2 times due to AM Container for appattempt_1386035090053_0009_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException: at org.apache.hadoop.util.Shell.runCommand(Shell.java:464) at org.apache.hadoop.util.Shell.run(Shell.java:379) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) .Failing this attempt.. Failing the application.

Posts	18
Solutions	0
Karma Given	0
Karma Received	6
Member Since	‎10-23-2013

Online Status	Offline
Date Last Visited	‎06-05-2020 02:04 AM

Issue with Hortonworks Yarn Sandbox (HDP 2) and Hu...

Re: I have downloaded Hunk VM (hunk-6.2-237464-Lin...

Re: I have downloaded Hunk VM (hunk-6.2-237464-Lin...

Re: I have downloaded Hunk VM (hunk-6.2-237464-Lin...

Re: For Hunk, how do you configure indexes.conf to...

Re: Does Hunk create an index?

Re: If using Hunk, do I lose any functionality?

Re: Hunk Tutorial - No Results Found

Re: Hunk Tutorial - No Results Found

Re: Hunk Tutorial - No Results Found

Re: Hunk Tutorial - No Results Found

Re: Hunk Tutorial - No Results Found

Re: error while connecting splunk with hadoop

Re: error while connecting splunk with hadoop

Re: Hunk with SimpleCSVRecordReader for TSV

Re: error while connecting splunk with hadoop

Re: What is the backend used in splunk?

Re: Issue with Hortonworks Yarn Sandbox (HDP 2) an...

Issue with Hortonworks Yarn Sandbox (HDP 2) and Hu...