Splunk Search

How can I populate a lookup without filling up my search queue

proletariat99
Communicator

I run a scheduled search over 100 days that baselines some user behavior and then saves the results off to a lookup.csv. There are 10^10 results, so needless to say, the search results cache is pretty large (in the GB's range). Unfortunately, these cached results are filling up my user queue and then I can't run any other searches. But I don't actually need or want the results cached. They can be discarded immediately upon completion of the query. Does anyone know a way to run this scheduled search (at midnight or whatever), write the results to a lookup file, and then remove the search results from local search head storage?

0 Karma

somesoni2
Revered Legend

If you've access to your savedsearches.conf where this search is saved, your can set the expiration time for search artifacts (including result cache in dispatch directory) so something lower. The property that you need to set is this.

dispatch.ttl = <integer>[p]
* Indicates the time to live (in seconds) for the artifacts of the scheduled search, if no
  actions are triggered.

See this for more information

http://docs.splunk.com/Documentation/Splunk/6.2.0/Admin/Savedsearchesconf

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...