Splunk Search

How can I populate a lookup without filling up my search queue

proletariat99
Communicator

I run a scheduled search over 100 days that baselines some user behavior and then saves the results off to a lookup.csv. There are 10^10 results, so needless to say, the search results cache is pretty large (in the GB's range). Unfortunately, these cached results are filling up my user queue and then I can't run any other searches. But I don't actually need or want the results cached. They can be discarded immediately upon completion of the query. Does anyone know a way to run this scheduled search (at midnight or whatever), write the results to a lookup file, and then remove the search results from local search head storage?

0 Karma

somesoni2
Revered Legend

If you've access to your savedsearches.conf where this search is saved, your can set the expiration time for search artifacts (including result cache in dispatch directory) so something lower. The property that you need to set is this.

dispatch.ttl = <integer>[p]
* Indicates the time to live (in seconds) for the artifacts of the scheduled search, if no
  actions are triggered.

See this for more information

http://docs.splunk.com/Documentation/Splunk/6.2.0/Admin/Savedsearchesconf

Get Updates on the Splunk Community!

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to Officially Supported Splunk ...

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI! Discover how Splunk’s agentic AI ...