Deployment Architecture

SPlunk Indexer clustering replication is Not working

deepak_negi02
New Member

We have 2 sites(site1,site2). Each site has 2 indexers each Site1(A,B) Site2(C,D) & 1 search Head each site.

Cluster Master server.conf is-
replication_factor = 2
search_factor = 1
buckets_to_summarize = primaries
summary_replication = 0
rebalance_threshold = 0.900000
multisite = true
site = site1
available_sites = site1,site2
site_replication_factor = origin:1, site1:2, site2:1, total:3
site_search_factor = origin:1, site1:1, site2:1, total:2

Replication factor and search factors were Met

After an incident, Site1 indexer A was down for an hour and we lost the data. As per the expectations, data should be coming via site1 indexer B. But it didn't

We made a small change in the server.conf but not sure, whether it shall do the job or not.
Current Cluster Master Server.conf-
replication_factor = 2
search_factor = 1
buckets_to_summarize = primaries
summary_replication = 0
rebalance_threshold = 0.900000
multisite = true
site = site1
available_sites = site1,site2
site_replication_factor = origin:2, total:3
site_search_factor = origin:1, total:2

Now, we still have to test it by brining Indexer A down. As of now, not sure if it's fixed.
Update- Earlier RF & SF used to be "MET" after
site_replication_factor = origin:2, total:3
site_search_factor = origin:1, total:2
RF is "NOT MET"

Let us know, what should be the right server.conf or any other missing configuration needed to ensure DR incase of 2 sites, 2 indexers each, 1 Search Head each site.

0 Karma

jkat54
SplunkTrust
SplunkTrust

The setup looks fine. I believe what happened was forwarder stickiness instead.

Forwarders will stick to indexers unless you enable time based autolb function in outputs.conf. Google “splunk forwarder stickiness” for some articles on it.

0 Karma

jkat54
SplunkTrust
SplunkTrust
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...