topic Re: CPU issues troubleshooting in Splunk AppDynamics

CPU issues troubleshooting

Mikel_Osinalde_ — Fri, 05 Apr 2019 08:43:18 GMT

Hi team,

We have a situation where every now an then the CPU is increased considerably, and never recovers, until the consumption gets to 100%.
To give you an example, if the first day of month the CPU is OK, one week later all in a sudden the CPU gets a peak and increases to 40%, and stays like that for some days. Then two weeks later the CPU suffers another peak and increases from 40% to 75%... and so on until by the end of the month the CPU gets to 100% and then we are forced to reboot.

I have noticed that the problematic process is the WAS portal where the web application is hosted, and we have an App agent enabled there.
In order to find the root cause, I have created a bunch of Business Transactions, so I could see which ones are CPU expensive. Unfortunately this didnt help, and couldn't get any connection between these CPU expensive BTs, and the CPU peaks.

Do you know any more effective method to troubleshoot these CPU issues?

I have found the following article:
https://community.appdynamics.com/t5/Knowledge-Base/How-do-I-troubleshoot-high-CPU-usage/ta-p/23266

But this is not exactly our case because the CPU peaks don't occur just when the agent is enabled.

Thanks!

Re: CPU issues troubleshooting

Peter_Holditch — Fri, 05 Apr 2019 09:40:07 GMT

Mikel,

Your post suggests that the CPU consumption does not seem to be correlated to load on the JVM, is that correct?

Have you looked at the memory statistics? When CPU runs away like this, excessive GC activity is often the cause.

If that does not show any promise, you can use AppDynamics to collect some thread-dumps, which should give you an indication as to what is going on.

Warm regards,

Peter

Re: CPU issues troubleshooting

Mikel_Osinalde_ — Fri, 05 Apr 2019 10:16:34 GMT

Hi Peter,

Indeed the CPU issue seems linked to the Garbage Collector:

Thanks for pointing me this out!

Now how would you further troubleshoot what apparently is a GC issue?

Re: CPU issues troubleshooting

Peter_Holditch — Fri, 05 Apr 2019 10:41:44 GMT

Mikel,

That is a very big topic! The documentation makes suggestions, and talks about the tooling we provide that may help here: https://docs.appdynamics.com/display/PRO45/Monitor+JVMs#MonitorJVMs-MemoryManagement

I hope this helps you get to root cause.

Warm regards,

Peter