Deployment Architecture

Cluster Master unable to send bundles to slave-apps directory on cluster peers

katelynengel
Explorer

The cluster master and cluster peers are fully set up and were successfully communicating. After upgrading all instances to 5.0.4, the cluster master is no longer able to successfully move configuration in cluster-apps on the cluster master to slave-apps on the cluster peers.

Receive the following errors in splunkd.log:

08-20-2013 13:35:43.529 -0400 ERROR CMSlave - Failed to move bundle to slave-apps
host=splunk-indexer6 Options| sourcetype=splunkd Options| source=/opt/splunk/var/log/splunk/splunkd.log

08-20-2013 13:35:43.528 -0400 ERROR CMSlave - Could not move /opt/splunk/var/run/splunk/cluster/remote-bundle/72329e457bf34d9351eb50a4dec40a85-1377020099/apps/_cluster to /opt/splunk/etc/slave-apps/_cluster

Tags (2)
0 Karma

icssupport
New Member

We already checked the permissions settings. We have another problem. But we are in contact with splunk support ...

0 Karma

icssupport
New Member

In our case:
Our directory $SPLUNK_HOME/var was located on another partition than $SPLUNK_HOME/etc and was referenced by a symlink.
Splunk was not able to move the bundle directory from one partition to another (/opt/splunk/var/run/splunk/cluster/remote-bundle/72329e457bf34d9351eb50a4dec40a85-1377020099/apps/_cluster to /opt/splunk/etc/slave-apps/_cluster).
Splunk considered this behaviour as a bug in 5.0.4 and planned to fix it.

0 Karma

davidpaper
Contributor

What was the solution?

0 Karma

mahamed_splunk
Splunk Employee
Splunk Employee

ICSSupport, Are you getting the same error message? It means that the directory _cluster has restricted permission. Could you check the permission settings of that directory?

0 Karma

icssupport
New Member

May I ask if this has already been solved and if yes, what was the solution?

0 Karma

mahamed_splunk
Splunk Employee
Splunk Employee

Could you check the permission on the _cluster directory?

0 Karma
Get Updates on the Splunk Community!

Splunk Training for All: Meet Aspiring Cybersecurity Analyst, Marc Alicea

Splunk Education believes in the value of training and certification in today’s rapidly-changing data-driven ...

The Splunk Success Framework: Your Guide to Successful Splunk Implementations

Splunk Lantern is a customer success center that provides advice from Splunk experts on valuable data ...

Investigate Security and Threat Detection with VirusTotal and Splunk Integration

As security threats and their complexities surge, security analysts deal with increased challenges and ...