Deployment Architecture

Replicating kvstore to a new cluster

GenRockeR
Explorer

Hi guys.
Please help me with replicating kvstore to a new cluster member.
I already try resync kvstore but still have replication error.
In mongo log file I've some errors with short read statuses.

2019-06-05T15:49:12.460Z I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to splunk-sh02:8191
 2019-06-05T15:49:12.462Z I ASIO     [NetworkInterfaceASIO-Replication-0] Failed to connect to splunk-sh02:8191 - HostUnreachable: short read
 2019-06-05T15:49:12.462Z I ASIO     [NetworkInterfaceASIO-Replication-0] Dropping all pooled connections to splunk-sh02:8191 due to failed operation on a connection
 2019-06-05T15:50:00.638Z I REPL_HB  [replexec-214] Error in heartbeat (requestId: 1721194) to splunk-sh02:8191, response status: HostUnreachable: short read

bash-4.2$ /opt/splunk/bin/splunk show kvstore-status

 This member:
                       backupRestoreStatus : Ready
                                  disabled : 0
                                      guid : D9F9CB60-E02D-4B3A-8376-58E2A5DC8F02
                                      port : 8191
                                standalone : 0
                                    status : starting

 Enabled KV store members: 
    splunk-sh11.sec.rambler.tech:8191
                                  guid : 6C58D8D2-2C37-492F-A14C-E32B7D55B040
                           hostAndPort : splunk-sh11:8191
    splunk-sh21:8191
                                  guid : 90730C74-4A10-423E-919B-6F88F01F3DF5
                           hostAndPort : splunk-sh21:8191
    splunk-sh02:8191
                                  guid : D9F9CB60-E02D-4B3A-8376-58E2A5DC8F02
                           hostAndPort : splunk-sh02:8191
0 Karma
Get Updates on the Splunk Community!

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...

.conf25 technical session recap of Observability for Gen AI: Monitoring LLM ...

If you’re unfamiliar, .conf is Splunk’s premier event where the Splunk community, customers, partners, and ...

A Season of Skills: New Splunk Courses to Light Up Your Learning Journey

There’s something special about this time of year—maybe it’s the glow of the holidays, maybe it’s the ...