AppD Archive

Instrumented Mbean metrics does not show up in Metric Browser

CommunityUser
Splunk Employee
Splunk Employee

I created some JMX metric configurations using Mbean matching patterns, but they don't show up under the metric browser.  We recently migrated the applicaiton from an old controller to a new one.

Tags (2)
0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hi Arun,

Thanks for your inputs. One correction - we have IBM WAS 7.0 (I really don't think that makes a difference in the scope of this).

1. Yes, the server exposes and lists "ActiveCount" metric under the mbean viewer (refere MB2.jpg)

2. Created ActiveCount1 under a different path (refer MB3.jpg)

3. Added ActiveCount and ActiveCount1 under "Attributes -> Define Metrics from MBean Attribute(s)" section under default jmx rule "WebSpherePMI_ThreadPools"

I still feel the issue is with the attribute showing up on the metric browser and not with creation/exposing the mbean attribute in the mbean browser. I've tried similar process with another variable Dyna Cache and it does not show up either.
Are there any known bugs on this topic for the AppD agent Server Agent v3.7.1.1?


Thanks,

Harsh

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Unable to attach screeenshots. Surprisingly the attachment feature has disappeared from the form!!

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hi Harsh Parekh,

You should be able to upload attachments to your posts now.

Sorry for the inconvenience.

Thanks,

0 Karma

Arun_Dasetty
Super Champion

Hi Harsh,

Thanks for sending the screenshots in email, please let us know how it goes after you tried as suggested in email i sent

Thanks,

Arun

0 Karma

Arun_Dasetty
Super Champion

Hi Harsh,

Thanks for sending the agent logs , we see couple of errors due to seond jmx tool monitor parallely for jmx metric, for which we currently have known issue, can you please try the suggested steps that i send in separate email and let us know how it goes.

Thanks,

Arun

0 Karma

Arun_Dasetty
Super Champion

Hi Harsh,

Thanks for sending the latest agent logs , as we could not see jmx metrics data in agent logs as agent is running in info mode please send the logs using log4j.xml file we sent which helps us to check the metrics reported for jmx custom metric created.


Thanks,

Arun

0 Karma

Arun_Dasetty
Super Champion

Hi,

Thanks for the update , the reason we have asked version is in specific to ibm docs

http://pic.dhe.ibm.com/infocenter/wasinfo/v7r0/index.jsp?topic=%2Fcom.ibm.websphere.nd.doc%2Finfo%2F...

where we see speical fix mentioned for ActiveCount metric, since you have confirmed that the ActiveCount metris is displayed fine under mbean viewer which confirms that server exposed that mbean, can you please send the screenshots and agent logs at akumar@appdynamics.com to debug further. we appreciate your cooperation while we are debugging this,

Please send us the requested details, which helps us to debug and replicate the scenario in local

Thanks,

Arun

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hi Arun,

I will make sure I post under the pro forum, once my id is associated with the license account.

- Yes, the JMX rule with mbean pattern showed up fine in metric browser of old controller.

- No, I do not have a wildcard in search pattern

- JMX rule screenshot attached for 'ActiveCount'. Expected path: JMX > Thread pools > threadpoolmodule > WebContainer (alongside with PoolSize attribute)

I have tried the following:

- Restart application servers

- Generated load (several times)

- Appd User account  has all privileges

Unfortunately, i do not have the old controller now, so I cant generate load on old controller.

Note that this configuration worked fine on the old controller. I believe there is some configuration I am missing out on after moving to the new controller. Some confiugration that has moved back to default.

Thanks so much!

-Harsh

0 Karma

Arun_Dasetty
Super Champion

Hi ,

Thanks for the update and screenshots can you please try the following:
- we see that PoolSize mbean displayed is part of default jmx metric rule config "WebSpherePMI_ThreadPools" as you are aware of

- Can you try either of the following and let us know if that makes any difference:
   1) We understood that you are using IBM WAS 7.1 or later version, Navigate to Node dashboard -> select "jmx" section -> click "mbean browser" -> expand "WebSpherePMI" object category -> and select thread pool -> and select the WebContainer and check if the server exposes and lists "ActiveCount" metric under the mbean viewer right screen

for selected mbean category

     - and if you see the "activecount" metric listed , right click on the metric and select create metric option to create rule, and provide different metric path for the rule to differentiate from"thread pools" section and check in metric browser after couple of minutes


  2) add "ActiveCount" attribute under "Attributes -> Define Metrics from MBean Attribute(s)" section under default jmx rule "WebSpherePMI_ThreadPools"

Please let us know how it goes.

Thanks,

Arun

0 Karma

Arun_Dasetty
Super Champion

Hi,

Thanks for writing to appsphere community forum. we understood that you are using pro version of the product, and from your comments we understood that you have configured jmx metric rule using mbean match patterns, but they don't show up in metric browser after controller migrated, let us know if any disconnect.

Can you please provide the following details:
- Can you confirm whether the jmx rule with mbean pattern shows up fine in metric browser in old controller metric browser?

- are using wild card in mbean pattern as we currently have a known issue with wild card in mbean rules for certain cases ?

- provide the jmx rule screenshot and location you are expecting in  metric browser in UI, also have you check with higher time trends to see the old load , can you generate load on app and check if that shows up.

Please send the requested logs when you post back

On a side note, we request you raise your pro queries using form at
http://appsphere.appdynamics.com/t5/forums/postpage/category-id/Discussions/choose-node/true/interac...
and select appropriate board option while posting query (say: appd pro or pro trial, instead lite general discussion section)

Thanks,

Arun

0 Karma
Get Updates on the Splunk Community!

See just what you’ve been missing | Observability tracks at Splunk University

Looking to sharpen your observability skills so you can better understand how to collect and analyze data from ...

Weezer at .conf25? Say it ain’t so!

Hello Splunkers, The countdown to .conf25 is on-and we've just turned up the volume! We're thrilled to ...

How SC4S Makes Suricata Logs Ingestion Simple

Network security monitoring has become increasingly critical for organizations of all sizes. Splunk has ...