topic What is the difference between the Kafka Messaging Modular Input and the Splunk Add-on for Kafka? in All Apps and Add-ons

What is the difference between the Kafka Messaging Modular Input and the Splunk Add-on for Kafka?

maximus_reborn — Sun, 15 May 2016 12:16:59 GMT

Maybe this question sounds naive, but what is the difference between both the Kafka Messaging Modular Input and the Splunk Add-on for Kafka?
I believe both are for extracting the messages from broker and indexing it. Can anyone please correct me if I am wrong?

Also, how do I configure the Kafka Messaging Modular Input developed by Damien? I have not found any clear documentation pertaining to its configuration.

Re: What is the difference between the Kafka Messaging Modular Input and the Splunk Add-on for Kafka?

a212830 — Sun, 15 May 2016 13:54:02 GMT

Looks to me like the Splunk add-on is for monitoring the performance of Kafaka, but the modular input is used to index data from kafka.

Personally, I'd like to see a streaming modular input, which allows me to read it, without indexing it (and maybe I'll win the lottery, right?)

Re: What is the difference between the Kafka Messaging Modular Input and the Splunk Add-on for Kafka?

jcoates_splunk — Wed, 18 May 2016 20:34:37 GMT

The Splunk supported add-on is also able to index Kafka payloads. http://docs.splunk.com/Documentation/AddOns/latest/Kafka/Configuremodularinputs

Re: What is the difference between the Kafka Messaging Modular Input and the Splunk Add-on for Kafka?

maximus_reborn — Thu, 19 May 2016 07:08:11 GMT

Thanks jcoates for the reply. So I have configured kafka add-on from CLI. But can you tell me the command to run it in SplunkWeb GUI.

Also,
Can I able to write correlation rules on it?
Basically I have 30 kafka topics that is to be streamed into splunk. My aim is only to insert the payload in splunk and have correlation rules on it.