All Apps and Add-ons

hadoop connection question

a212830
Champion

Hi,

I'm testing out Hadoop Connect (and, hopefully, Shuttl). In Hadoop Connect, I get an error when attempting to add a hdfs cluster. It says "nvalid HADOOP_HOME. Cannot find Hadoop command under bin directory HADOOP_HOME='blahblahblah'. I checked with the Hadoop folks, and they have assured me that the Hadoop command exists in that structure. Am I missing something? Looking at the pop-up, it almost looks like the app is expecting Hadoop to exist on the Splunk server as well?

Tags (1)
0 Karma
1 Solution

bosburn_splunk
Splunk Employee
Splunk Employee

A212830,
You will need to install the hadoop CLI first - http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/HadoopCLI. You can test to make sure it's working by signing in as the Splunk user and attempting to run the hadoop command.

View solution in original post

bosburn_splunk
Splunk Employee
Splunk Employee

A212830,
You will need to install the hadoop CLI first - http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/HadoopCLI. You can test to make sure it's working by signing in as the Splunk user and attempting to run the hadoop command.

bosburn_splunk
Splunk Employee
Splunk Employee

Everything is driven via the search head...

0 Karma

a212830
Champion

Thanks. Another question on Hadoop Connect - how does it work in a distributed environment? Do I need to put it on each indexer, or is everything driven from the search-head?

0 Karma
Get Updates on the Splunk Community!

September Community Champions: A Shoutout to Our Contributors!

As we close the books on another fantastic month, we want to take a moment to celebrate the people who are the ...

Splunk Decoded: Service Maps vs Service Analyzer Tree View vs Flow Maps

It’s Monday morning, and your phone is buzzing with alert escalations – your customer-facing portal is running ...

What’s New in Splunk Observability – September 2025

What's NewWe are excited to announce the latest enhancements to Splunk Observability, designed to help ITOps ...