Getting Data In

Anyone have a practical guide to metric collection performance and hardware?



I am expecting to need to collect up to 1 billion collectD metrics per second for a Cloud install we're helping support. Anyone have a scoping guide for how many ref indexers I might need?


0 Karma

Splunk Employee
Splunk Employee

Hi Daniel, 1b metrics per second sounds a lot higher than most use cases I've seen so far, and would require a significant investment into indexers. It would be helpful if you could shed a bit more light on your use case and collectd set-up (collection frequency etc) to also look at some of your alternatives and options.

0 Karma
.conf21 CFS Extended through 5/20!

Don't miss your chance
to share your Splunk
wisdom in-person or
virtually at .conf21!

Call for Speakers has
been extended through
Thursday, 5/20!