Have you tried the Website Monitoring app ?
It doesn't come with alerts setup , but it will certainly index all the information you require so that you can write your own scheduled searches and wire up alerts.
Damien, I wasn't aware of this app thanks very much.
I am trying to install the app, but keep getting the same error when trying to configure. I have cleared caches and tried different browsers, checked CPU and RAM usage also all other Splunk apps work fine.
Encountered the following error while trying to update: Splunkd daemon is not responding: (u'Error connecting to /servicesNS/nobody/websitemonitoring/apps/local/websitemonitoring/setup: The read operation timed out',)
Let me know how you fixed that issue. I would like to fix this in the app itself. This is the first I have heard of this problem. I tried to reproduce on several combinations of platforms and Splnk versions but I haven't been able to reproduce it yet.
The app ships with a saved search called "websiteperformanceproblems". You can open that search in Splunk's search editor and enable actions in order to get alerted to failures.