topic Re: Custom whitelist for Search Head Cluster Replication in Deployment Architecture

Custom whitelist for Search Head Cluster Replication

dilipbailwal — Mon, 28 Sep 2020 19:56:30 GMT

i have been trying to create a custom white list for Search Head Cluster Replication under one of the cluster member at "splunk_home/etc/system/local/server.conf ", but it seems not working.

Here is the content of server.conf

Custom changes replicated

conf_replication_include.web = true

where, i am trying to add web.conf to be replicated across. itself.. Even this file is located at "/splunk_home/etc/system/local/web.conf"

Also i did rolling restart after its default 5 second window did not replicated..
./splunk rolling-restart shcluster-members

hence still no sign of file getting replicated..

Re: Custom whitelist for Search Head Cluster Replication

jtrucks — Mon, 11 May 2015 13:42:32 GMT

I suspect these file names are case sensitive in the configuration, so rename your file server.conf instead of SERVER.CONF and try again.

Re: Custom whitelist for Search Head Cluster Replication

dilipbailwal — Tue, 12 May 2015 10:32:59 GMT

it was case typo in question.. not the case with my config files on servers..

Re: Custom whitelist for Search Head Cluster Replication

jtrucks — Tue, 12 May 2015 15:28:25 GMT

You should mark this answer as "Accepted" so people know what the answer was, as well as to get credit for answering your own question here. 🙂

Re: Custom whitelist for Search Head Cluster Replication

dilipbailwal — Wed, 13 May 2015 07:58:53 GMT

Its not the answer jtrucks.. and what i am trying to say here is, it was a typo on my question where server.conf was written in upper case.. which i have fixed and the main issue still exist..

Re: Custom whitelist for Search Head Cluster Replication

steven_swor — Mon, 15 Jun 2015 03:07:29 GMT

I've deployed several apps over the last couple weeks in a SHC environment, with extra configs that needed to be replicated. My experience so far has been that:

splunk rolling-restart shcluster-members does not cause the new replication configs to be loaded from server.conf
Once the extra replication configs have been properly loaded by all the cluster members, the replication is only triggered when you make changes via the web UI (e.g. if there already was a $SPLUNK_HOME/etc/system/local/web.conf, it won't be replicated until you change it again via the web UI)
If the app requires configuring a password as part of the setup process, the passwords may not be replicated across the search head cluster (even if the rest of the config file is replicated), so you have to log into each search head in the cluster and set the password explicitly. I saw this when setting up SA-ldapsearch, Splunk App for VMWare, and Splunk App for NetApp Data ONTAP.

The most reliable way I've found of ensuring the new conf_replication_include... settings are loaded properly has been to undeploy an app from the search head cluster and then redeploy it. On the deployer:

Move an app from $SPLUNK_HOME/etc/shcluster/apps to a temporary location
Run splunk apply shcluster-bundle ... to roll out the search head cluster apps
Move the app back into $SPLUNK_HOME/etc/shcluster/apps
run splunk apply shcluster-bundle ... again to redeploy the bundle

Note that this will trigger two rolling restarts of the search head cluster (one when you undeploy the app and one when you re-deploy it). After this is done, the replication settings should take effect the next time you make a change through the web interface.

As a best practice, I'd recommend creating a "poison pill" app on the deployer. The app itself has all the required folder structure and contents to be treated as a valid Splunk app, but it does nothing (e.g. no inputs, dashboards, saved searches, et cetera). You can undeploy and re-deploy it at-will, to trigger the restarts properly, without losing important configs from "real" apps.

Re: Custom whitelist for Search Head Cluster Replication

dilipbailwal — Thu, 18 Jun 2015 08:12:11 GMT

All rite Steven, i am gonna give that a shot by creating a poison pill