Knowledge Management

What are best practices for setting polling intervals on each machine to collect system metrics?

josefa123
Explorer

Anyone of you has a best practice on implementing the best polling interval of each machine data? I am still puzzled on how to determine the polling rate of each. Make it too frequent, it will generate noise, make it too slow, it will reduce accuracy. Any help guys on what are the things that I need to consider?

Thank you so much

0 Karma

renjith_nair
Legend

It depends on what you are going to do with the metrics and your use cases. If its about scheduling alert, minimum preferable interval should be 1-2 minutes. And then your polling interval should be adjusted to that.

For almost all the metrics , we are polling every 5 minutes for most of the system metrics and 1 day for ssl certificates, licenses etc which does not change in few minutes.

Refer here also

https://answers.splunk.com/answers/5136/time-interval-for-searches.html

https://wiki.splunk.com/Community:Best_practices_for_Splunk_alerting

---
What goes around comes around. If it helps, hit it with Karma 🙂

josefa123
Explorer

Thanks for your suggestions. But how can you say that you need data every 5 minutes? why not every 4? or 6? do you calculate data integrity over noise? I think what I need here is the proof why I choose the interval and why not something else.

0 Karma

renjith_nair
Legend

Its completely depends on your requirement. For example polling interval for my disk space is every 5 minutes. Because i know there are no process which might right 100GB of data in 5 minutes. But it might not be your case. So depends on what you collect and how you use and for what purpose, it changes 🙂

---
What goes around comes around. If it helps, hit it with Karma 🙂
0 Karma

josefa123
Explorer

I appreciate your feedback and suggestion, but dont you guys have any framework on how do you determine each machine data that you are sampling? Thanks

0 Karma

josefa123
Explorer

Isn't it considered a "guess" when you just put x hour on this x machine data just because you know that it doesnt change every x minute?

0 Karma

renjith_nair
Legend

Sorry but no we don't have any such framework

---
What goes around comes around. If it helps, hit it with Karma 🙂
0 Karma

renjith_nair
Legend

Are you referring to the system metrics like CPU,RAM,DISK etc?

---
What goes around comes around. If it helps, hit it with Karma 🙂
0 Karma

josefa123
Explorer

yes. Every machine data that needs to be monitored. How are guys determine what is the best polling rate of each? Do you have a computation or something?

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Unlock What’s Next: The Splunk Cloud Platform at .conf25

In just a few days, Boston will be buzzing as the Splunk team and thousands of community members come together ...