How to stream data from Splunk to Kafka?

[KrutikaDe]

Hi All,

We are trying to stream alert data from systems like Splunk, Nagios etc to Hadoop using Kafka and Spark.

We are unable to find any information regarding forwarding alert data from Splunk to Kafka.

Our alert data streaming is going to be like below -

Splunk-->Kafka-->Spark-->Hadoop-->Reporting(Tableau)

Our goal is to form reports with alert data from different systems.
Please suggest us about any other approaches, if feasible.

[rdagan_splunk · Accepted solution]

You can use a software like Apache NiFi to do the Splunk to Kafka.

Try to use Nifi processors GetSplunk -> PublishKafka. At least in my experiment it worked very nicely.