All Apps and Add-ons

Splunk Add-on for Kafka: Does managing inputs manually from each Heavy Forwarder create duplicates?

Harishma
Communicator

I have two Heavy Forwarders configured with the Splunk Add-on for Kafka. Now if I manually create input topic messages from each forwarder, won't that become a duplicate?
I wanna maintain a balanced topic load between these two forwarders? How do I achieve this?

Sorry if my doubts seem naive, cos I'm just trying a POC on Kafka-Splunk connect.

0 Karma

rpille_splunk
Splunk Employee
Splunk Employee

Hi Harishma,

Yes, it is possible to accidentally create duplicates using this manual method, so when you select the topics to collect on each forwarder, you have to ensure that you don't collect the same topics from more than one forwarder.

The documentation for the steps to follow is here: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_manu...

If you want instead to have the topic collection split up over several heavy forwarders automatically, use this method instead: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_cent...

Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...