Deployment Architecture

Indexer Clustering and Index Replication: How many indexes can Splunk handle?

Anthony_Hou
Path Finder

Hi All,

Splunk indexer cluster index replication: how many indexes can Splunk handle?
We have 300 indexes.
Is there any limitation about index replication?

tks~:)

0 Karma
1 Solution

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

View solution in original post

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

Anthony_Hou
Path Finder

tks for your answer, it helps a lot.

0 Karma
Get Updates on the Splunk Community!

.conf24 | Day 0

Hello Splunk Community! My name is Chris, and I'm based in Canberra, Australia's capital, and I travelled for ...

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

(view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...