Getting Data In

Forward data to two different indexers and filter a field out

klim
Path Finder

I need to forward data from a heavy forwarder to two different indexer clusters. One of the clusters needs to have a field removed. If I use sedcmd in props.conf on the HF it removes it for both and putting sedcmd in props.conf on one of the indexers doesn't work (it does work if i bypass the HF). 

Is there a way to do this?

Edit: I was thinking of using an intermediate forwarder so heavy forwarder -> another heavy forwarder -> indexer cluster but the intermediate heavy forwarder props.conf does not work.

Labels (1)
0 Karma

PickleRick
SplunkTrust
SplunkTrust

What is it with the latest peak of question about "sending the data into two indexer(s| clusters) while modifying one stream"? Suddenly everyone has this borderline use case?

Why do that in the first place? Is it really worth paying extra for double the license? What actually is your use case?

0 Karma

PaulPanther
Motivator

Try to set 

sendCookedData=false

for the second HF output in your outputs.conf and then apply your props.conf on your second HF. 

 

0 Karma

PickleRick
SplunkTrust
SplunkTrust

This will actually send raw data suitable to further processing by third party solution. It will not keep the metadata, it will not use s2s protocol, just send "TCP syslog" stream.

 

0 Karma
Get Updates on the Splunk Community!

Community Content Calendar, November Edition

Welcome to the November edition of our Community Spotlight! Each month, we dive into the Splunk Community to ...

October Community Champions: A Shoutout to Our Contributors!

As October comes to a close, we want to take a moment to celebrate the people who make the Splunk Community ...

Stay Connected: Your Guide to November Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...