Hi @aaronkorn
I've seen posts similar to your question. Check these out and see if they're helpful with understanding your issue.
http://answers.splunk.com/answers/141179/how-to-remove-automatic-real-time-searches-that-run-when-us...
http://answers.splunk.com/answers/103589/search-summary-page-automatically-runs-real-time-searches