Your'e going to want to use the REST API to grab the fired alerts
http://docs.splunk.com/Documentation/Splunk/6.2.2/RESTREF/RESTsearch#alerts.2Ffired_alerts.2F.7Bname...
It looks like you might want to enact a naming convention to make your life easier since it seems like you have a certain set of fired alerts you want to pull...
you can then use the rest
command to build your search for your dashboard
Mind you... this is for "Fired and unexpired alerts" so you'll want to be sure you've adjusted that setting (when you create the alert... or in the savedsearches.conf so that your fired alerts don't die to quickly)
The default is 24 hours... I think.
http://docs.splunk.com/Documentation/Splunk/6.2.2/SearchReference/Rest