I'm interested in the mechanics of a base search (for a dashboard). Where would the results of a base search be stored? Is this held in memory?
I'm thinking that if you have a large number of users, effectively running many base searches, the storage requirement might become quite big?
I have experimented with storing intermediate search results in a kvstore (using a custom command) to accelerate the searches in my dashboards, but this has the problem that it does not scale well. If I have concurrent users, one might overwrite the data in the kvstore while the other is running a search.
The results of base searches, like other searches, are stored in the dispatch directory. Yes, if there are many searches or searches with many results then the storage requirements could become quite large.
The results of base searches, like other searches, are stored in the dispatch directory. Yes, if there are many searches or searches with many results then the storage requirements could become quite large.