All Apps and Add-ons

Splunk Connect for Kafka how to

jbanAtSplunk
Communicator

Hi,

I dont have any exp with Kafka but we need to send data from Kafka to Splunk.

I am reading documentation but dont understand what we need to do.

Ok, HEC on Splunk and configure HEC options. But what with .jar (or how to build Docker). Do we need to "build .jar" and than put it into Kafka plugin folder or is there some way that we build connector that will connect to Kafka (like for example Redis or RabbitMQ, like middleware).

Tnx. any help is appreciated.

Labels (2)
0 Karma

ilya_resh
Engager

@jbanAtSplunk , There is a good quick explanation by @daniel_splunk here https://community.splunk.com/t5/All-Apps-and-Add-ons/Any-quick-startup-guide-to-do-end-to-end-testin...

I've also started "putting on paper" my journey with Splunk Connect for Kafka here: http://isbyr.com/splunk-connect-for-kafka/ still work in progress, but might help a bit (though nothing about docker, as I was using "plain" VMs)

0 Karma

jbanAtSplunk
Communicator

Tnx. for replay (will have an eye on provided links :slightly_smiling_face: ).

I solved this with logstash as it have Kafka Input plugin so it's straight forward with kafka input and then output  json (to file) and read file with Splunk Universal forwarder.

0 Karma
Get Updates on the Splunk Community!

See just what you’ve been missing | Observability tracks at Splunk University

Looking to sharpen your observability skills so you can better understand how to collect and analyze data from ...

Weezer at .conf25? Say it ain’t so!

Hello Splunkers, The countdown to .conf25 is on-and we've just turned up the volume! We're thrilled to ...

How SC4S Makes Suricata Logs Ingestion Simple

Network security monitoring has become increasingly critical for organizations of all sizes. Splunk has ...