All Apps and Add-ons

Splunk Add-on for Kafka: Does managing inputs manually from each Heavy Forwarder create duplicates?

Harishma
Communicator

I have two Heavy Forwarders configured with the Splunk Add-on for Kafka. Now if I manually create input topic messages from each forwarder, won't that become a duplicate?
I wanna maintain a balanced topic load between these two forwarders? How do I achieve this?

Sorry if my doubts seem naive, cos I'm just trying a POC on Kafka-Splunk connect.

0 Karma

rpille_splunk
Splunk Employee
Splunk Employee

Hi Harishma,

Yes, it is possible to accidentally create duplicates using this manual method, so when you select the topics to collect on each forwarder, you have to ensure that you don't collect the same topics from more than one forwarder.

The documentation for the steps to follow is here: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_manu...

If you want instead to have the topic collection split up over several heavy forwarders automatically, use this method instead: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_cent...

Get Updates on the Splunk Community!

Join Us for Splunk University and Get Your Bootcamp Game On!

If you know, you know! Splunk University is the vibe this summer so register today for bootcamps galore ...

.conf24 | Learning Tracks for Security, Observability, Platform, and Developers!

.conf24 is taking place at The Venetian in Las Vegas from June 11 - 14. Continue reading to learn about the ...

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...