Getting Data In

can a forwarder send data to hadoop

a212830
Champion

Hi,

Is a UFW capable of sending data to Hadoop? Is there a supported integration between the two at this level? I know that Hadoop Connect can do it, but we are looking at all our options.

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

Currently there is no supported integration between forwarders and Hadoop. However, you can write some sort of a solution that uses ' Forwarders into a file -> every few seconds or minutes you stop the streaming into the file and create an actual file -> use Hadoop command line to copy the file into HDFS '.

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

A Universal Forwarder can send data to any third party system that can receive TCP: http://docs.splunk.com/Documentation/Splunk/6.0.3/Forwarding/Forwarddatatothird-partysystemsd#Forwar...

0 Karma
Get Updates on the Splunk Community!

Join Us for Splunk University and Get Your Bootcamp Game On!

If you know, you know! Splunk University is the vibe this summer so register today for bootcamps galore ...

.conf24 | Learning Tracks for Security, Observability, Platform, and Developers!

.conf24 is taking place at The Venetian in Las Vegas from June 11 - 14. Continue reading to learn about the ...

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...