Getting Data In

How can I Read HDFS data into Splunk?

mruchi1004
New Member

I have an HDFS path where new data is being written whenever my job runs. My jobs are already logging into Splunk . How can i get the data from the HDFS path to Splunk to send alerts whenever anything new is written onto that HDFS path? I don't want to use Splunk hadoop Connect.

Tags (1)
0 Karma

vishaltaneja070
Motivator
0 Karma

mruchi1004
New Member

Thanks Vishal! I have already found this documentation, but i cannot have Splunk Hadoop Connect app in Splunk Environment because of org Restrictions.
Please suggest some other ways if you know any.

0 Karma

vishaltaneja070
Motivator

@mruchi1004

The way is to copy files only like mentioned in the below link:
https://www.splunk.com/blog/2012/03/12/simple-splunking-of-hdfs-files.html

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

How about the product Splunk Analytics for Hadoop? Is that product also has org restrictions?
https://www.splunk.com/en_us/products/apps-and-add-ons/splunk-analytics-for-hadoop.html

0 Karma
Get Updates on the Splunk Community!

Splunk Cloud | Empowering Splunk Administrators with Admin Config Service (ACS)

Greetings, Splunk Cloud Admins and Splunk enthusiasts! The Admin Configuration Service (ACS) team is excited ...

Tech Talk | One Log to Rule Them All

One log to rule them all: how you can centralize your troubleshooting with Splunk logs We know how important ...

Splunk Security Content for Threat Detection & Response, Q1 Roundup

Join Principal Threat Researcher, Michael Haag, as he walks through: An introduction to the Splunk Threat ...