Getting Data In

Filter data on indexer or heavy forwarder?

rjfv8205
Path Finder

Hello, actually we don't have heavy forwarder instance.

Is it possible filter events in indexer when recieve data from UF's? How much performance affect?

Tags (1)
0 Karma

ktn01
Path Finder

Example to drop events that do not contain $LOG$:

prop.conf

 [source_event]
 TRUNCATE = 15000
 TRANSFORMS-filter = event_drop,event_take

transforms.conf

[event_drop]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

[event_take]
REGEX = \$\$LOGS\$\$
DEST_KEY = queue
FORMAT = indexQueue 

Hope it help

Christian

0 Karma

rjfv8205
Path Finder

Thanks for your answer. My other question is how much performance affect if filter events directly on indexer?

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...