Alerting

Trigger alert if value is above for a period of time

jbrolland
Engager

Hello

I would like to trigger an alert if value "pending" is above a value ( > 500) for a period of time (> 5 min).

If during those 5 minutes, the value go under 500 I don't want the alert to be triggered.

 

Here is the alert if above 500

index=my_index sourcetype=source:type "request(s) still pending"

| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" | where pending > 500

 

How can I add the alert only if value is above 500 for more than 5minutes?

 

Labels (1)
0 Karma
1 Solution

manjunathmeti
Champion

hi @jbrolland ,
You can schedule the alert every five minutes and in the search query check if the minimum pending value is greater than 500 in the last five minutes. If yes, then raise an alert.

index=my_index sourcetype=source:type "request(s) still pending"
| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" 
| stats min(pending) as min_pending_value
| where min_pending_value > 500

 

If this reply helps you, an upvote/like would be appreciated. 

View solution in original post

manjunathmeti
Champion

hi @jbrolland ,
You can schedule the alert every five minutes and in the search query check if the minimum pending value is greater than 500 in the last five minutes. If yes, then raise an alert.

index=my_index sourcetype=source:type "request(s) still pending"
| rex field=_raw "(?ms)^(?:[^ \\n]* ){7}(?P<pending>\\d+)" 
| stats min(pending) as min_pending_value
| where min_pending_value > 500

 

If this reply helps you, an upvote/like would be appreciated. 

jbrolland
Engager

Very smart, thanks!

0 Karma
Get Updates on the Splunk Community!

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to ...

Announcing the Migration of the Splunk Add-on for Microsoft Azure Inputs to Officially Supported Splunk ...