Splunk Search

How to schedule a search every 15 minutes to compare results of the same day/time from the last 3 weeks and measure standard deviation?

akhan8928
New Member

Hey all,

We are recording very order we receive as an event. What I'd like to do is get a count every 15 minutes real time of how many orders have come in and based on the last three weeks to that day see if there was a deviation.

E..g 4:45pm Thurs Sept 4th would be compared to Aug 28th, 21st and 14th on the graph. Also we'd like to measure the std dev to see if it is +/- 1 and alert if it is.

I know we can do this in splunk but I can't seem to 1. Get the timechart/timewrap done right and 2 tell Splunk how to compare specific days of the prior 3 weeks.

0 Karma

prelert
Path Finder

Of course this is going to sound like a shameless plug, but honestly, the easiest way to do this is with the Prelert Anomaly Detective app.

Here's an example of Anomaly Detective being used against data that are "orders" - which, probably like your data, is cyclical (periodic) in nature:

http://support.prelert.com/customer/portal/articles/1551666-periodic-data---event-rate-anomaly-detec...

By the way, don't get caught up in trying to use standard deviation as your approach to express anomalousness. Standard deviation assumes that the data samples (in this case, "counts of errors") conforms to a nice, symmetrical Gaussian Bell curve. In most cases, counts of things are better modeled by Poisson curves. Anomaly Detective automatically figures out the best statistical model for your data to maximize accuracy and minimize false alerting.

0 Karma

ppablo
Retired

Hi @akhan8928

I edited your question to best reflect your use case. I just wanted to clarify that since you want the search to run every 15 minutes, you want the results, for example, from 4:45pm Thurs Sept 4th to be compared with 4:45pm Aug 28th, 4:45pm Aug 21st, 4:45pm Aug 14th correct? You said you wanted the results "on the last three weeks to that day", but you didn't mention time.

0 Karma
Get Updates on the Splunk Community!

Observability Highlights | January 2023 Newsletter

 January 2023New Product Releases Splunk Network Explorer for Infrastructure MonitoringSplunk unveils Network ...

Security Highlights | January 2023 Newsletter

January 2023 Splunk Security Essentials (SSE) 3.7.0 ReleaseThe free Splunk Security Essentials (SSE) 3.7.0 app ...

Platform Highlights | January 2023 Newsletter

 January 2023Peace on Earth and Peace of Mind With Business ResilienceAll organizations can start the new year ...