By default deployer merges both local and default directories then pushes apps to search heads. Check your changes in default directories on search heads.
It might be something to do with default.xml in your app. Check if following content is there in the default.xml in $SPLUNK_HOME/etc/apps/yourapp/default/data/ui/nav/. If not add it in the app on deployer server, deploy apps again and check.