All Apps and Add-ons

hadoop connection question

a212830
Champion

Hi,

I'm testing out Hadoop Connect (and, hopefully, Shuttl). In Hadoop Connect, I get an error when attempting to add a hdfs cluster. It says "nvalid HADOOP_HOME. Cannot find Hadoop command under bin directory HADOOP_HOME='blahblahblah'. I checked with the Hadoop folks, and they have assured me that the Hadoop command exists in that structure. Am I missing something? Looking at the pop-up, it almost looks like the app is expecting Hadoop to exist on the Splunk server as well?

Tags (1)
0 Karma
1 Solution

bosburn_splunk
Splunk Employee
Splunk Employee

A212830,
You will need to install the hadoop CLI first - http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/HadoopCLI. You can test to make sure it's working by signing in as the Splunk user and attempting to run the hadoop command.

View solution in original post

bosburn_splunk
Splunk Employee
Splunk Employee

A212830,
You will need to install the hadoop CLI first - http://docs.splunk.com/Documentation/HadoopConnect/latest/DeployHadoopConnect/HadoopCLI. You can test to make sure it's working by signing in as the Splunk user and attempting to run the hadoop command.

bosburn_splunk
Splunk Employee
Splunk Employee

Everything is driven via the search head...

0 Karma

a212830
Champion

Thanks. Another question on Hadoop Connect - how does it work in a distributed environment? Do I need to put it on each indexer, or is everything driven from the search-head?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Observability Simplified: Combining User Experience, Application Performance & ...

Tech Talk Observability Simplified: Combining User Experience, Application Performance & Network ...

Event Series May & June: From Network Visibility to Service Intelligence

Unifying the Network: Moving from Alert Noise to Service Intelligence with Splunk ITSI In today’s hybrid ...

Global Splunk User Group Events: May + June 2026

Your Splunk Community Awaits: Discover Upcoming User Group Events Worldwide    Staying ahead in the fast-paced ...