It sounds like you're trying to change a setting that is defined in the search app. Know that config files are processed in alphabetical order by app name so 'search' will take precedence over a later name such as 'thisismyapp'. The solution is to change your app to come before 'search'.
You can use
splunk btool --debug props list to detect this situation before restarting Splunk.