Knowledge Management

Does the performance of the kvstore lookup definition improve when it filters the original collection?

landen99
Motivator

When a kvstore lookup definition filters a kvstore of 1 million events down to 300k, does performance improve vs using the original kvstore collection unfiltered?

0 Karma
1 Solution

landen99
Motivator

http://docs.splunk.com/Documentation/Splunk/latest/Admin/Transformsconf?splunkbot

filter = <string>
* Filter results from the lookup table before returning data. Create this filter like you would a typical search query using Boolean expressions and/or comparison operators.
* For KV Store lookups, filtering is done when data is initially retrieved to improve performance.
* For CSV lookups, filtering is done in memory.

It looks like performance is improved after the filter is applied on reading the kvstore.

View solution in original post

0 Karma

landen99
Motivator

http://docs.splunk.com/Documentation/Splunk/latest/Admin/Transformsconf?splunkbot

filter = <string>
* Filter results from the lookup table before returning data. Create this filter like you would a typical search query using Boolean expressions and/or comparison operators.
* For KV Store lookups, filtering is done when data is initially retrieved to improve performance.
* For CSV lookups, filtering is done in memory.

It looks like performance is improved after the filter is applied on reading the kvstore.

0 Karma
Get Updates on the Splunk Community!

Database Performance Sidebar Panel Now on APM Database Query Performance & Service ...

We’ve streamlined the troubleshooting experience for database-related service issues by adding a database ...

IM Landing Page Filter - Now Available

We’ve added the capability for you to filter across the summary details on the main Infrastructure Monitoring ...

Dynamic Links from Alerts to IM Navigators - New in Observability Cloud

Splunk continues to improve the troubleshooting experience in Observability Cloud with this latest enhancement ...