Getting Data In

adding new indexer in existing distributed environment

ramsanga
Explorer

i currently have one indexer and two search heads with one search head with ES. I am planning to add two new indexers in existing setup for load balance and convert existing indexer into heavy forwarder. I am sure i can copy existing indexed DB to one of the newly to be deployed indexer, stop indexing in old indexer and configuring forwarding only . My question is how can i achieve load balance in new setup retaining old indexed data.

Tags (2)
0 Karma

sourabh_varshne
Explorer

Once you add up the two indexers , your new environment will have two indexers, two search heads and one heavy forwarder. Now to enable load balancing follow the below steps.

  1. Enable load balancing at Heavy Forwarders by editing outputs.conf autoLBFrequency = 40 server = \ips of indexers useACK = true
  2. Increase queue size maxQueueSize = 100 MB

This will enable load balancing of data at your indexers. Also enable replication between both of your indexers. Hope this answers your question

ramsanga
Explorer

Thanks sourabh. Just wrt your comment earlier, can replication be enabled with two indexer. According to document, we need one seperate master node and then at least two peer nodes for replication (clustering).please advise..In addition. will replication not not cause low search and indexing performance?

0 Karma

sourabh_varshne
Explorer

Yes you can follow that link. Its perfectly demostrated. You can copy buckets directl and restart your cluster.

0 Karma

ramsanga
Explorer

thanks for your answer on LB side. I wanted to know the best way to copy old indexed data into two new indexer so that i can search old data. I read the article http://answers.splunk.com/answers/6521/expanding-splunk-installation-from-a-single-indexer-to-a-mult...
does this work?

Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Unlock What’s Next: The Splunk Cloud Platform at .conf25

In just a few days, Boston will be buzzing as the Splunk team and thousands of community members come together ...