Deployment Architecture

Indexer Clustering and Index Replication: How many indexes can Splunk handle?

Anthony_Hou
Path Finder

Hi All,

Splunk indexer cluster index replication: how many indexes can Splunk handle?
We have 300 indexes.
Is there any limitation about index replication?

tks~:)

0 Karma
1 Solution

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

View solution in original post

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

Anthony_Hou
Path Finder

tks for your answer, it helps a lot.

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...