topic Re: How can I Read HDFS data into Splunk? in Getting Data In

How can I Read HDFS data into Splunk?

mruchi1004 — Thu, 07 Feb 2019 06:48:55 GMT

I have an HDFS path where new data is being written whenever my job runs. My jobs are already logging into Splunk . How can i get the data from the HDFS path to Splunk to send alerts whenever anything new is written onto that HDFS path? I don't want to use Splunk hadoop Connect.

Re: How can I Read HDFS data into Splunk?

vishaltaneja070 — Thu, 07 Feb 2019 08:06:19 GMT

@mruchi2004

Check this:

https://docs.splunk.com/Documentation/HadoopConnect/1.2.5/DeployHadoopConnect/ImportfromHDFS

Re: How can I Read HDFS data into Splunk?

mruchi1004 — Thu, 07 Feb 2019 08:30:06 GMT

Thanks Vishal! I have already found this documentation, but i cannot have Splunk Hadoop Connect app in Splunk Environment because of org Restrictions.
Please suggest some other ways if you know any.

Re: How can I Read HDFS data into Splunk?

vishaltaneja070 — Thu, 07 Feb 2019 08:43:39 GMT

@mruchi1004

The way is to copy files only like mentioned in the below link:
https://www.splunk.com/blog/2012/03/12/simple-splunking-of-hdfs-files.html

Re: How can I Read HDFS data into Splunk?

rdagan_splunk — Fri, 08 Feb 2019 01:36:21 GMT

How about the product Splunk Analytics for Hadoop? Is that product also has org restrictions?
https://www.splunk.com/en_us/products/apps-and-add-ons/splunk-analytics-for-hadoop.html