All Apps and Add-ons

How to stream data from Splunk to Kafka?

KrutikaDe
New Member

Hi All,

We are trying to stream alert data from systems like Splunk, Nagios etc to Hadoop using Kafka and Spark.

We are unable to find any information regarding forwarding alert data from Splunk to Kafka.

Our alert data streaming is going to be like below -

Splunk-->Kafka-->Spark-->Hadoop-->Reporting(Tableau)

Our goal is to form reports with alert data from different systems.
Please suggest us about any other approaches, if feasible.

0 Karma
1 Solution

rdagan_splunk
Splunk Employee
Splunk Employee

You can use a software like Apache NiFi to do the Splunk to Kafka.

Try to use Nifi processors GetSplunk -> PublishKafka. At least in my experiment it worked very nicely.

View solution in original post

rdagan_splunk
Splunk Employee
Splunk Employee

You can use a software like Apache NiFi to do the Splunk to Kafka.

Try to use Nifi processors GetSplunk -> PublishKafka. At least in my experiment it worked very nicely.

Get Updates on the Splunk Community!

The Splunk Success Framework: Your Guide to Successful Splunk Implementations

Splunk Lantern is a customer success center that provides advice from Splunk experts on valuable data ...

Splunk Training for All: Meet Aspiring Cybersecurity Analyst, Marc Alicea

Splunk Education believes in the value of training and certification in today’s rapidly-changing data-driven ...

Investigate Security and Threat Detection with VirusTotal and Splunk Integration

As security threats and their complexities surge, security analysts deal with increased challenges and ...