Removing just the SubmitButton wont make the view read-only.
You'll have to remove the SearchBar, the TimeRangePicker and the SubmitButton, as all three of these modules can push new search data downstream, and it's these downstream pushes that cause searches to get kicked off.
If your view file is in advanced xml form, then look for the SubmitButton module (e.g.
<module name="SubmitButton"></module> ) and remove it from the view.
The view file will be in either