Has anyone here set an alert in Splunk monitoring of Salesforce that runs a script on alert action that calls back in to the org? I'm just now looking at the possibility of creating some "self healing" alerting for a recurring issue we have in SF prod (scheduled batch jobs falling out of queue) and saw the option to run a script in Splunk on alert.
Salesforce has an executeanonymous (string apexcode) method through Tooling API exposed in both SOAP and REST. My thought was to have a class built in my SF Prod org that Splunk could just call in to which would handle the logic of finding what's fallen out of spool & kick off the script to put it back in the hopper.