I am getting the following error on the Search Head Load balancer VIP and the search head cluster member:
[muw1splmonpin06] Failed to create a bundles setup with server name '537ECF93-E615-4B96-A740-0AB501D766DE'. Using peer's local bundles to execute the search, results might not be correct
[muw1splmonpin07] Failed to create a bundles setup with server name '537ECF93-E615-4B96-A740-0AB501D766DE'. Using peer's local bundles to execute the search, results might not be correct.
Along with the above message, I can see that the Job details says as "Gave up waiting for the captain to establish a common bundle version across all search peers; using most recent bundles on all peers instead".
I don't see any of the above errors on the Search Head Captian node when I execute the search. I have verified the search peers on all the search head members is same across. Can you guide or assist on what could cause this issue and how to fix it?
What version of Splunk? Earlier than 6.5.2? If so, update to at least 6.5.2, but preferably 6.5.3. There were bugs in the bundle stuff prior to 6.5.2. We had trouble on both search heads and indexers with the bundles being applied. Apparently the full bundle was p[ushed and if they were large, there were problems. When we upgraded to 6.5.2 all those problems went away.
That sounds like the issue. The bundles were too big, which would time out when being transmitted, causing the failure. Subsequent bundle pushes may or may not work. We had some bundles so big that at least one failed every time for more than a day. That was fixed with the upgrade.