All Apps and Add-ons

Splunk Add-on for Kafka: Does managing inputs manually from each Heavy Forwarder create duplicates?

Harishma
Communicator

I have two Heavy Forwarders configured with the Splunk Add-on for Kafka. Now if I manually create input topic messages from each forwarder, won't that become a duplicate?
I wanna maintain a balanced topic load between these two forwarders? How do I achieve this?

Sorry if my doubts seem naive, cos I'm just trying a POC on Kafka-Splunk connect.

0 Karma

rpille_splunk
Splunk Employee
Splunk Employee

Hi Harishma,

Yes, it is possible to accidentally create duplicates using this manual method, so when you select the topics to collect on each forwarder, you have to ensure that you don't collect the same topics from more than one forwarder.

The documentation for the steps to follow is here: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_manu...

If you want instead to have the topic collection split up over several heavy forwarders automatically, use this method instead: http://docs.splunk.com/Documentation/AddOns/released/Kafka/Configuremodularinputs#Manage_inputs_cent...

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...