Getting Data In

Anyone have a practical guide to metric collection performance and hardware?

daniel333
Builder

All,

I am expecting to need to collect up to 1 billion collectD metrics per second for a Cloud install we're helping support. Anyone have a scoping guide for how many ref indexers I might need?

thanks
-Daniel

0 Karma

mporath_splunk
Splunk Employee
Splunk Employee

Hi Daniel, 1b metrics per second sounds a lot higher than most use cases I've seen so far, and would require a significant investment into indexers. It would be helpful if you could shed a bit more light on your use case and collectd set-up (collection frequency etc) to also look at some of your alternatives and options.

0 Karma
.conf21 Now Fully Virtual!
Register for FREE Today!

We've made .conf21 totally virtual and totally FREE! Our completely online experience will run from 10/19 through 10/20 with some additional events, too!