Splunk Search

How to get alerts when event X isn't followed by event Y within a certain length of time?

andrew_burnett
Path Finder

I need an alert where you get this message "Attempting to send email to:<email>" but you don't ever get the message "Email sent successfully" within 1-2 minutes. The problem is if you don't get the second message, a restart will be required before you do. So I need event 1, but no event 2

Labels (1)
Tags (2)
0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @andrew_burnett,

you should try something like this:

index=your_index ("Attempting to send email to:" OR "Email sent successfully")
| eval message_kind=if(searchmatch("Attempting to send email to:"),"1","2")
| stats dc(message_kind) AS dc_message_kind values(message_kind) AS message_kind
| where dc_message_kind=1 AND message_kind="1"

Ciao.

Giuseppe

0 Karma

andrew_burnett
Path Finder

My question about it is, when the "Attempting to send email to:" gets stuck, all the logs stop. Would that search work in this case?

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @andrew_burnett,

as you asked the above search takes logs and check if the first message is followed by the second, the alert triggers when the first message isn't followed by the second (the where condition).

Ciao.

Giuseppe

0 Karma
Get Updates on the Splunk Community!

September Community Champions: A Shoutout to Our Contributors!

As we close the books on another fantastic month, we want to take a moment to celebrate the people who are the ...

Splunk Decoded: Service Maps vs Service Analyzer Tree View vs Flow Maps

It’s Monday morning, and your phone is buzzing with alert escalations – your customer-facing portal is running ...

What’s New in Splunk Observability – September 2025

What's NewWe are excited to announce the latest enhancements to Splunk Observability, designed to help ITOps ...