Knowledge Management

Does the performance of the kvstore lookup definition improve when it filters the original collection?

landen99
Motivator

When a kvstore lookup definition filters a kvstore of 1 million events down to 300k, does performance improve vs using the original kvstore collection unfiltered?

0 Karma
1 Solution

landen99
Motivator

http://docs.splunk.com/Documentation/Splunk/latest/Admin/Transformsconf?splunkbot

filter = <string>
* Filter results from the lookup table before returning data. Create this filter like you would a typical search query using Boolean expressions and/or comparison operators.
* For KV Store lookups, filtering is done when data is initially retrieved to improve performance.
* For CSV lookups, filtering is done in memory.

It looks like performance is improved after the filter is applied on reading the kvstore.

View solution in original post

0 Karma

landen99
Motivator

http://docs.splunk.com/Documentation/Splunk/latest/Admin/Transformsconf?splunkbot

filter = <string>
* Filter results from the lookup table before returning data. Create this filter like you would a typical search query using Boolean expressions and/or comparison operators.
* For KV Store lookups, filtering is done when data is initially retrieved to improve performance.
* For CSV lookups, filtering is done in memory.

It looks like performance is improved after the filter is applied on reading the kvstore.

0 Karma
Get Updates on the Splunk Community!

Say goodbye to manually analyzing phishing and malware threats with Splunk Attack ...

In today’s evolving threat landscape, we understand you’re constantly bombarded with phishing and malware ...

AppDynamics is now part of Splunk Ideas

Hello Splunkers, We have exciting news for you! AppDynamics has been added to the Splunk Ideas Portal. Which ...

Advanced Splunk Data Management Strategies

Join us on Wednesday, May 14, 2025, at 11 AM PDT / 2 PM EDT for an exclusive Tech Talk that delves into ...