I have alerts setup that work but I cant use the email function or the script function to be able to see them when they happen. I am trying not to have to go to the trigger alerts page every time just to review the results. I would assume there is a way to get them to trigger in real time if I am using Splunk or at least have them in the message box for Splunk.
Can anyone help with this?
Actually you can create a dashboard whose search and time window will be same as that of your alert. This will help you see the alert result on a dashboard and you don't have to navigate to alert triggered page.
So if I have an alert that run every 5 mins it would update every 5 mins? But if I need to see previous results how would that be able to do that?
I saw that webhook is supposed to be able to create a popup does anyone have information on doing that?
You can adjust the time span of the search in the dashboard panel according to the duration you would like to see the alert result for.
Also, webhook does let you make an alert message pop up. You can refer the below link which describes how to configure that.
Hope that helps you!
You can create report/dashboard with below search:
index=_audit action="alert_fired" | rename ss_name AS title | join title [ | rest /services/saved/searches | table title, alert_threshold ] | timechart values(alert_threshold) AS alert_threshold count by title
In order for Splunk to send an email, Splunk must be able to connect to a valid email server with an appropriate user name (and password.) This is configured by the Splunk system admin; in the GUI, the email settings can be found under Settings >> Server settings >> Email settings