Getting Data In

How can I Read HDFS data into Splunk?

mruchi1004
New Member

I have an HDFS path where new data is being written whenever my job runs. My jobs are already logging into Splunk . How can i get the data from the HDFS path to Splunk to send alerts whenever anything new is written onto that HDFS path? I don't want to use Splunk hadoop Connect.

Tags (1)
0 Karma

vishaltaneja070
Motivator
0 Karma

mruchi1004
New Member

Thanks Vishal! I have already found this documentation, but i cannot have Splunk Hadoop Connect app in Splunk Environment because of org Restrictions.
Please suggest some other ways if you know any.

0 Karma

vishaltaneja070
Motivator

@mruchi1004

The way is to copy files only like mentioned in the below link:
https://www.splunk.com/blog/2012/03/12/simple-splunking-of-hdfs-files.html

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

How about the product Splunk Analytics for Hadoop? Is that product also has org restrictions?
https://www.splunk.com/en_us/products/apps-and-add-ons/splunk-analytics-for-hadoop.html

0 Karma
Get Updates on the Splunk Community!

Good Sourcetype Naming

When it comes to getting data in, one of the earliest decisions made is what to use as a sourcetype. Often, ...

See your relevant APM services, dashboards, and alerts in one place with the updated ...

As a Splunk Observability user, you have a lot of data you have to manage, prioritize, and troubleshoot on a ...

Splunk App for Anomaly Detection End of Life Announcement

Q: What is happening to the Splunk App for Anomaly Detection?A: Splunk is officially announcing the ...