Alerting

Trigger alert if value is above for a period of time

jbrolland
Engager

Hello

I would like to trigger an alert if value "pending" is above a value ( > 500) for a period of time (> 5 min).

If during those 5 minutes, the value go under 500 I don't want the alert to be triggered.

 

Here is the alert if above 500

index=my_index sourcetype=source:type "request(s) still pending"

| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" | where pending > 500

 

How can I add the alert only if value is above 500 for more than 5minutes?

 

Labels (1)
0 Karma
1 Solution

manjunathmeti
Champion

hi @jbrolland ,
You can schedule the alert every five minutes and in the search query check if the minimum pending value is greater than 500 in the last five minutes. If yes, then raise an alert.

index=my_index sourcetype=source:type "request(s) still pending"
| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" 
| stats min(pending) as min_pending_value
| where min_pending_value > 500

 

If this reply helps you, an upvote/like would be appreciated. 

View solution in original post

manjunathmeti
Champion

hi @jbrolland ,
You can schedule the alert every five minutes and in the search query check if the minimum pending value is greater than 500 in the last five minutes. If yes, then raise an alert.

index=my_index sourcetype=source:type "request(s) still pending"
| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" 
| stats min(pending) as min_pending_value
| where min_pending_value > 500

 

If this reply helps you, an upvote/like would be appreciated. 

jbrolland
Engager

Very smart, thanks!

0 Karma
Get Updates on the Splunk Community!

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...

Integrating Splunk Search API and Quarto to Create Reproducible Investigation ...

 Splunk is More Than Just the Web Console For Digital Forensics and Incident Response (DFIR) practitioners, ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...