Deployment Architecture

Indexer Clustering and Index Replication: How many indexes can Splunk handle?

Anthony_Hou
Path Finder

Hi All,

Splunk indexer cluster index replication: how many indexes can Splunk handle?
We have 300 indexes.
Is there any limitation about index replication?

tks~:)

0 Karma
1 Solution

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

View solution in original post

esix_splunk
Splunk Employee
Splunk Employee

There's no hard limit really. But it is a big dependent on the total amount of data you are indexing and your disks along with the efficiency of your indexing strategy, including autoLB, rep and search factor. I've encountered TB+ a day customers with over 1000 indexes.

If you are actively indexing data to every single index, then Splunk may have a hard time keeping up with all of the sourcetyping parsing. CPU time is another possible bottleneck, so monitoring of cpu time is also recommended. Offloading parsing to an aggregation tier is also recommended..

Here is a good starting point : http://docs.splunk.com/Documentation/Splunk/6.3.2/Capacity/DimensionsofaSplunkEnterprisedeployment

Anthony_Hou
Path Finder

tks for your answer, it helps a lot.

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...