Alerting

My alert keeps getting auto disabled

delgendy
Explorer

I have an alert that keeps getting auto disabled, how can I identify this from the internal logs.
I want to run a search on the internal logs to know when this alert got disabled and to alert off .

Tags (1)
0 Karma

p_gurav
Champion

You can try this search to get last run of that alert before it disabled:

index=_internal sourcetype=scheduler  | stats latest(_time) as last_event by savedsearch_name | eval last_run=tostring(now()-last_event,"duration") | eval last_event=strftime(last_event, "%Y-%m-%d %H:%M:%S")
0 Karma

delgendy
Explorer

Is there any log level as Warning or Error in the internal logs that would tell me it is disabled? This is what I was leaning towards this more than getting the time difference.
However still your answer is helpful and i will try that thanks

0 Karma
Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

New This Month - Observability Updates Give Extended Visibility and Improve User ...

This month is a collection of special news! From Magic Quadrant updates to AppDynamics integrations to ...

Intro to Splunk Synthetic Monitoring

In our last post, we mentioned that the 3 key pieces of observability – metrics, logs, and traces – provide ...