When uninstalling an app, the following errors are preventing splunkd for restarting:
03-30-2010 22:28:12.157 WARN DeployedApplication - Uninstalling application: sample_app
03-30-2010 22:28:12.157 WARN DeployedApplication - Removing app at location: /opt/splunk/etc/apps/sample_app
03-30-2010 22:30:06.068 ERROR IniFile - Cannot open ini file for parsing: No such file or directory
03-30-2010 22:30:06.068 ERROR ConfObjectManagerDB - Cannot initialize: /opt/splunk/etc/apps/sample_app/metadata/default.meta
I copied the entire default app/* structure (except search) to my deployment-apps directory on the deployment server. This file exists on the forwarders prior to the uninstallation. After a manual restart, everything seems to work fine.
I realize I can just set stateOnClient = disabled, but there may be cases when we want to completely remove custom apps.