Deployment Architecture

Indexer Clustering and Index Replication: How many indexes can Splunk handle?

Anthony_Hou
Path Finder

Hi All,

Splunk indexer cluster index replication: how many indexes can Splunk handle?
We have 300 indexes.
Is there any limitation about index replication?

tks~:)

0 Karma
1 Solution

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

View solution in original post

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

Anthony_Hou
Path Finder

tks for your answer, it helps a lot.

0 Karma
Get Updates on the Splunk Community!

Say goodbye to manually analyzing phishing and malware threats with Splunk Attack ...

In today’s evolving threat landscape, we understand you’re constantly bombarded with phishing and malware ...

AppDynamics is now part of Splunk Ideas

Hello Splunkers, We have exciting news for you! AppDynamics has been added to the Splunk Ideas Portal. Which ...

Advanced Splunk Data Management Strategies

Join us on Wednesday, May 14, 2025, at 11 AM PDT / 2 PM EDT for an exclusive Tech Talk that delves into ...