We are sending some data to splunk then to hadoop connect. Is it possible to send data directly to hadoop connect without using splunk?
Hi @vijaysri,
Of course it's possible, if you're using syslog you can simply send the data straight into Hadoop :
https://www.syslog-ng.com/community/b/blog/posts/filling-your-data-lake-with-log-messages-the-syslog...
Hadoop will not give you the real time capability that Splunk has though and you want data going there first if you're looking for real time. But it all depends on your use-case. What you are trying to achieve exactly is what will defined whether you need the data in Splunk, Hadoop, or both.
Cheers,
David