Alerting

Setting alerts on exceptions

usmanchaudhri
Engager

Hi,

I potentially want to set a scheduled search - where i specify the list of exceptions in the search - and if there is any new exception outside of those listed exceptions, Splunk should send an email alert.

For example: Consider, here is my list of exceptions: "error: null pointer exception (login.class:1494)" "error: database down exception (database.class:1594)" "error: read PFD (readPDF.class:1694)"

Now, whenever there is a new exception generated (outside of those listed above), Splunk sends me alert.

Thanks for looking into this. Usman Chaudhri

Tags (1)
1 Solution

David
Splunk Employee
Splunk Employee

The way I did this was to set up eventtypes.conf so that each event has an eventtype. You can then run a query:

YourSearch NOT eventtype=*

And that will show all the events that aren't on your pre-defined list. You can toss that in a scheduled search no problem.

http://www.splunk.com/base/Documentation/latest/Admin/eventtypesconf

View solution in original post

0 Karma

David
Splunk Employee
Splunk Employee

The way I did this was to set up eventtypes.conf so that each event has an eventtype. You can then run a query:

YourSearch NOT eventtype=*

And that will show all the events that aren't on your pre-defined list. You can toss that in a scheduled search no problem.

http://www.splunk.com/base/Documentation/latest/Admin/eventtypesconf

0 Karma

David
Splunk Employee
Splunk Employee

That sounds like a good solution. For my use case, we had a relatively small number of events (45 or so) with fairly unique descriptors. Having a specific event type to each error message also allows me to toss up a dashboard with the daily average over the last month for each event type, compared with the last 24 hours. That way I can catch changes in known errors. Food for thought 😉

0 Karma

usmanchaudhri
Engager

Yeah, that's what i ended up doing. I saved a search as an eventtype, the search had the pre-defined list of events. Than i went ahead and scheduled another search and just specified eventtype!=< predefine list >. This gave me list of new events.

Thank you
Usman Chaudhri

0 Karma
Get Updates on the Splunk Community!

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI!Discover how Splunk’s agentic AI ...

Splunk Enterprise Security 8.x: The Essential Upgrade for Threat Detection, ...

Watch On Demand the Tech Talk on November 6 at 11AM PT, and empower your SOC to reach new heights! Duration: ...

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...