Just in case anyone has the same issue as me. My KV store was broken which stopped task server from starting splunkd.log 05-31-2024 01:59:56.804 +0000 ERROR ExecProcessor [1322 ExecProcessor] - message from "/opt/splunk/etc/apps/splunk_app_db_connect/bin/dbxquery.sh" 01:59:56.804 [main] INFO com.splunk.dbx.utils.SecurityFilesGenerator - Initializing secret kv store collection 05-31-2024 01:59:56.867 +0000 ERROR ExecProcessor [1322 ExecProcessor] - message from "/opt/splunk/etc/apps/splunk_app_db_connect/bin/dbxquery.sh" 01:59:56.867 [main] INFO com.splunk.dbx.utils.SecurityFilesGenerator - secret KV Store not found, creating mongod.log 2024-05-31T03:20:05.019Z I ACCESS [main] permissions on /opt/splunk/var/lib/splunk/kvstore/mongo/splunk.key are too open Changing the permissions on /opt/splunk/var/lib/splunk/kvstore/mongo/splunk.key to 400 and restarting fixed the issue for me ... View more