Knowledge Management

Slow search for squid for a 30 days report

pinzer
Path Finder

hi all, i have a problem with a squid search, it is very very slow (over 30 minutes to load) the search is this:

sourcetype="squid" | timechart span="1d" sum(size)

the time for the search is 30 days. How can i speed this search?

the extraction field for the size parameter is

(?i)^[^/]*/\d+\s+(?P<size>[^ ]+)
0 Karma
1 Solution

dwaddle
SplunkTrust
SplunkTrust

Summary indexing is one way to speed this up. Conceptually, you tell Splunk to pre-compute this data for smaller intervals (say once per day) - and then you use that pre-computed data to complete your intended search faster.

http://www.splunk.com/base/Documentation/latest/Knowledge/Usesummaryindexing

View solution in original post

dwaddle
SplunkTrust
SplunkTrust

Summary indexing is one way to speed this up. Conceptually, you tell Splunk to pre-compute this data for smaller intervals (say once per day) - and then you use that pre-computed data to complete your intended search faster.

http://www.splunk.com/base/Documentation/latest/Knowledge/Usesummaryindexing

dwaddle
SplunkTrust
SplunkTrust

You can find information on scheduling searches in the Splunk docs at http://www.splunk.com/base/Documentation/latest/User/SchedulingSavedSearches

0 Karma

pinzer
Path Finder

how can i schedule the search every hour?

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...