Searchheads can not pull apps from Deployer on ansible env, error 401

[sarit_s]

- We tried to implement shclustering with splunk-ansible (https://github.com/splunk/splunk-ansible)
- But it is not possible to deploy apps from deployer, because scripts do not run initial push (unless specyfing splunk.apps_location), they rely on pulling configs from deployer instead

Problem is that pulling configs from deployer does not work until first push from deployer. Internally this request to deployer 'GET /services/apps/deploy?output_mode=json HTTP/1.1' fails with 401 status.
After the first push, this request is processed correctly with status 200.

I tried to reproduce error internally (outside ansible) and managed to do it, can provide you diags with debug logs.

I consider either Deployer implementation must be improved or ansible scripts to correctly handle shc.

 Steps to reproduce

1. Deploy SHCluster, 2. Restart any member of SHCluster, 3. Check its splunkd.log

[masonmorales]

If you're trying to manage apps on a SHC that is either bare metal, or running on VMs, take a look at: https://github.com/splunk/ansible-role-for-splunk

If you're trying to do it in Docker, I'd recommend filing an issue on the splunk-ansible GitHub project at:  https://github.com/splunk/splunk-ansible/issues