topic Splunk Connect for Kafka how to in All Apps and Add-ons

Splunk Connect for Kafka how to

jbanAtSplunk — Mon, 10 May 2021 12:37:54 GMT

Hi,

I dont have any exp with Kafka but we need to send data from Kafka to Splunk.

I am reading documentation but dont understand what we need to do.

Ok, HEC on Splunk and configure HEC options. But what with .jar (or how to build Docker). Do we need to "build .jar" and than put it into Kafka plugin folder or is there some way that we build connector that will connect to Kafka (like for example Redis or RabbitMQ, like middleware).

Tnx. any help is appreciated.

Re: Splunk Connect for Kafka how to

ilya_resh — Fri, 25 Jun 2021 05:38:57 GMT

@jbanAtSplunk , There is a good quick explanation by @daniel_splunk here https://community.splunk.com/t5/All-Apps-and-Add-ons/Any-quick-startup-guide-to-do-end-to-end-testing-from-kafka-to/m-p/406327/highlight/true#M49536

I've also started "putting on paper" my journey with Splunk Connect for Kafka here: http://isbyr.com/splunk-connect-for-kafka/ still work in progress, but might help a bit (though nothing about docker, as I was using "plain" VMs)

Re: Splunk Connect for Kafka how to

jbanAtSplunk — Fri, 25 Jun 2021 08:42:37 GMT

Tnx. for replay (will have an eye on provided links 🙂 ).

I solved this with logstash as it have Kafka Input plugin so it's straight forward with kafka input and then output json (to file) and read file with Splunk Universal forwarder.