All Apps and Add-ons

Data is not coming in splunk from kafka server

MoniM
Communicator

Hi All,
I am trying to get data from a kafka server, but the data in not coming up in splunk. Below points checked:-
1. ports are checked for hec, kafka and splunk, all are working and accessible i.e (telnet is enable, but ping is not)
2. hec token also setup in splunk.
3. kafka is also starting without any issue.
4. kafka is also showing active connectors and their configurations.
5. in kafka connector, parameters are according to the document.

Kindly help me with the above issue.

i followed the below document for the "splunk connect for kafka" configuration:-
https://docs.splunk.com/Documentation/KafkaConnect/1.1.0/User/ConfigureSplunkKafkaConnect

0 Karma

hijacob
Communicator

Hi Moni,

did you look at the troubleshooting page? https://docs.splunk.com/Documentation/KafkaConnect/1.1.0/User/Troubleshootyourdeployment

Greetings,
Jacob

0 Karma

MoniM
Communicator

Hi Jacob,
Thanks for the quick revert.
yes, i have checked the troubleshooting steps also. its splunk.hec.ack.enabled="true" and splunk.indexes=[index_name] in No events are arriving in Splunk topic.
Am i missing anything else?

rdagan_splunk
Splunk Employee
Splunk Employee

Do you see any errors?

0 Karma

MoniM
Communicator

Hi @rdagan and @hijacob ,
yes, i got the error of java. in kafka server the java version was openJDK 1.8.0, so up-gradation to java8 resolved the issue.
thanks for the help.

0 Karma
.conf21 Now Fully Virtual!
Register for FREE Today!

We've made .conf21 totally virtual and totally FREE! Our completely online experience will run from 10/19 through 10/20 with some additional events, too!