topic Re: Java agent not responding to Payara in Splunk AppDynamics

Java agent not responding to Payara

Hossam_Elneily — Sun, 28 Nov 2021 09:33:55 GMT

the agent was reported successfully until the following error happened
ِِERROR NetVizAgentRequest - Fatal transport error while connecting to URL [http://127.0.0.1:3892/api/agentinfo?timestamp=0&agentType=APP_AGENT&agentVersion=0.10.0]: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:3892 [/127.0.0.1] failed: Connection refused (Connection refused)

Re: Java agent not responding to Payara

Morelz — Sun, 28 Nov 2021 11:50:53 GMT

The error you see is related to Network visibility. By default the Java agent is trying to send data to the Network Visibility agent on the server that it's running on. If the network visibility agent is not installed/running, you will see this error. I believe in the latest release of the agent java agent this value is set to false by default, to not generate this error.

Technically this should not interfere with the Java agent itself and would just fill up the logs with unnecessary errors.

To stop this error from occurring you can set a agent node property to tell the java agent to not send data to the NetViz agent as its not installed and/or running. Or you can install the NetViz agent if you want to accept the data from the Java Agent.

https://docs.appdynamics.com/21.11/en/application-monitoring/administer-app-server-agents/app-agent-node-properties-reference/app-agent-node-properties-s

Node Agent property below

name : socket-enabled

type : boolean

value : false

Save and apply to the agent.

Ciao

Re: Java agent not responding to Payara

Hossam_Elneily1 — Sun, 28 Nov 2021 12:29:24 GMT

Thank you Mario for your reply.

So this is not the actual error that makes the agent not respond correctly to the controller
i found the following error in the log as well.

ERROR GlassfishJerseyInterceptor - Exception detected:
java.lang.NullPointerException: null
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.isDiscoveryEnabled(ATransactionAcceptor.java:615) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.discoverTransactionName(ATransactionAcceptor.java:665) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRsTransactionAcceptor.getNameFromConfiguredNamingScheme(JaxRsTransactionAcceptor.java:93) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointMatchConfigResolver.resolveServiceEndpoint(ServiceEndpointMatchConfigResolver.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.resolveServiceEndPoint(ServiceEndpointDetector.java:184) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.identifyEntryServiceEndPoint(ServiceEndpointDetector.java:246) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.acceptAndIdentifyServiceEndPoint(ATransactionAcceptor.java:210) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor._onMethodBeginTracked(ATransactionEntryPointInterceptor.java:390) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor.onMethodBeginTracked(ATransactionEntryPointInterceptor.java:167) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRSIdentificationInterceptor.onMethodBeginTracked(JaxRSIdentificationInterceptor.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.bciengine.AFastTrackedMethodInterceptor.onMethodBegin(AFastTrackedMethodInterceptor.java:52) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBeginNoReentrantCheck(FastMethodInterceptorDelegatorImpl.java:370) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBegin(FastMethodInterceptorDelegatorImpl.java:295) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.entrypoint.bciengine.FastMethodInterceptorDelegatorBoot.safeOnMethodBegin(FastMethodInterceptorDelegatorBoot.java:52) ~[?:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java) ~[?:?]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[?:?]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[?:?]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) ~[?:?]
at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:356) ~[?:?]
at org.glassfish.admin.rest.adapter.JerseyContainerCommandService$3.service(JerseyContainerCommandService.java:179) ~[?:?]
at org.glassfish.admin.rest.adapter.RestAdapter.service(RestAdapter.java:189) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper$HttpHandlerCallable.call(ContainerMapper.java:520) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:217) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.runService(HttpHandler.java:182) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.doHandle(HttpHandler.java:156) ~[?:?]
at org.glassfish.grizzly.http.server.HttpServerFilter.handleRead(HttpServerFilter.java:218) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.nio.transport.TCPNIOTransport.fireIOEvent(TCPNIOTransport.java:524) ~[?:?]
at org.glassfish.grizzly.strategies.AbstractIOStrategy.fireIOEvent(AbstractIOStrategy.java:89) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.run0(WorkerThreadIOStrategy.java:94) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.access$100(WorkerThreadIOStrategy.java:33) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy$WorkerThreadRunnable.run(WorkerThreadIOStrategy.java:114) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[?:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]

Re: Java agent not responding to Payara

Hossam_Elneily1 — Sun, 28 Nov 2021 12:34:20 GMT

Thank you Mario for your feedback

I understood that is not the actual error that makes the agent not respond to the controller
kindly check the following error i found in the same log:

ERROR GlassfishJerseyInterceptor - Exception detected:
java.lang.NullPointerException: null
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.isDiscoveryEnabled(ATransactionAcceptor.java:615) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.discoverTransactionName(ATransactionAcceptor.java:665) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRsTransactionAcceptor.getNameFromConfiguredNamingScheme(JaxRsTransactionAcceptor.java:93) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointMatchConfigResolver.resolveServiceEndpoint(ServiceEndpointMatchConfigResolver.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.resolveServiceEndPoint(ServiceEndpointDetector.java:184) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.identifyEntryServiceEndPoint(ServiceEndpointDetector.java:246) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.acceptAndIdentifyServiceEndPoint(ATransactionAcceptor.java:210) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor._onMethodBeginTracked(ATransactionEntryPointInterceptor.java:390) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor.onMethodBeginTracked(ATransactionEntryPointInterceptor.java:167) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRSIdentificationInterceptor.onMethodBeginTracked(JaxRSIdentificationInterceptor.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.bciengine.AFastTrackedMethodInterceptor.onMethodBegin(AFastTrackedMethodInterceptor.java:52) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBeginNoReentrantCheck(FastMethodInterceptorDelegatorImpl.java:370) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBegin(FastMethodInterceptorDelegatorImpl.java:295) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.entrypoint.bciengine.FastMethodInterceptorDelegatorBoot.safeOnMethodBegin(FastMethodInterceptorDelegatorBoot.java:52) ~[?:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java) ~[?:?]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[?:?]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[?:?]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) ~[?:?]
at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:356) ~[?:?]
at org.glassfish.admin.rest.adapter.JerseyContainerCommandService$3.service(JerseyContainerCommandService.java:179) ~[?:?]
at org.glassfish.admin.rest.adapter.RestAdapter.service(RestAdapter.java:189) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper$HttpHandlerCallable.call(ContainerMapper.java:520) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:217) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.runService(HttpHandler.java:182) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.doHandle(HttpHandler.java:156) ~[?:?]
at org.glassfish.grizzly.http.server.HttpServerFilter.handleRead(HttpServerFilter.java:218) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.nio.transport.TCPNIOTransport.fireIOEvent(TCPNIOTransport.java:524) ~[?:?]
at org.glassfish.grizzly.strategies.AbstractIOStrategy.fireIOEvent(AbstractIOStrategy.java:89) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.run0(WorkerThreadIOStrategy.java:94) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.access$100(WorkerThreadIOStrategy.java:33) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy$WorkerThreadRunnable.run(WorkerThreadIOStrategy.java:114) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[?:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]

Re: Java agent not responding to Payara

iamryan — Mon, 29 Nov 2021 18:23:50 GMT

Hi @Hossam.Elneily and @Mario.Morelli

A few of these replies were caught in spam. I just released them, so please continue the conversation!