Splunk AppDynamics

Java agent not responding to Payara

Hossam_Elneily
New Member

the agent was reported successfully  until the following error happened
ِِERROR NetVizAgentRequest - Fatal transport error while connecting to URL [http://127.0.0.1:3892/api/agentinfo?timestamp=0&agentType=APP_AGENT&agentVersion=0.10.0]: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:3892 [/127.0.0.1] failed: Connection refused (Connection refused)

Labels (1)
0 Karma

Morelz
Motivator

Hi

The error you see is related to Network visibility. By default the Java agent is trying to send data to the Network Visibility agent on the server that it's running on. If the network visibility agent is not installed/running, you will see this error. I believe in the latest release of the agent java agent this value is set to false by default, to not generate this error.

Technically this should not interfere with the Java agent itself and would just fill up the logs with unnecessary errors.

To stop this error from occurring you can set a agent node property to tell the java agent to not send data to the NetViz agent as its not installed and/or running. Or you can install the NetViz agent if you want to accept the data from the Java Agent.

https://docs.appdynamics.com/21.11/en/application-monitoring/administer-app-server-agents/app-agent-...

Node Agent property below

name : socket-enabled

type : boolean

value : false

Save and apply to the agent.

Ciao

Hossam_Elneily1
Engager

Thank you Mario for your feedback 

I understood that is not the actual error that makes the agent not respond to the controller 
kindly check the following error i found in the same log:

ERROR GlassfishJerseyInterceptor - Exception detected:
java.lang.NullPointerException: null
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.isDiscoveryEnabled(ATransactionAcceptor.java:615) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.discoverTransactionName(ATransactionAcceptor.java:665) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRsTransactionAcceptor.getNameFromConfiguredNamingScheme(JaxRsTransactionAcceptor.java:93) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointMatchConfigResolver.resolveServiceEndpoint(ServiceEndpointMatchConfigResolver.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.resolveServiceEndPoint(ServiceEndpointDetector.java:184) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.identifyEntryServiceEndPoint(ServiceEndpointDetector.java:246) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.acceptAndIdentifyServiceEndPoint(ATransactionAcceptor.java:210) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor._onMethodBeginTracked(ATransactionEntryPointInterceptor.java:390) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor.onMethodBeginTracked(ATransactionEntryPointInterceptor.java:167) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRSIdentificationInterceptor.onMethodBeginTracked(JaxRSIdentificationInterceptor.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.bciengine.AFastTrackedMethodInterceptor.onMethodBegin(AFastTrackedMethodInterceptor.java:52) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBeginNoReentrantCheck(FastMethodInterceptorDelegatorImpl.java:370) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBegin(FastMethodInterceptorDelegatorImpl.java:295) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.entrypoint.bciengine.FastMethodInterceptorDelegatorBoot.safeOnMethodBegin(FastMethodInterceptorDelegatorBoot.java:52) ~[?:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java) ~[?:?]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[?:?]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[?:?]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) ~[?:?]
at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:356) ~[?:?]
at org.glassfish.admin.rest.adapter.JerseyContainerCommandService$3.service(JerseyContainerCommandService.java:179) ~[?:?]
at org.glassfish.admin.rest.adapter.RestAdapter.service(RestAdapter.java:189) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper$HttpHandlerCallable.call(ContainerMapper.java:520) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:217) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.runService(HttpHandler.java:182) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.doHandle(HttpHandler.java:156) ~[?:?]
at org.glassfish.grizzly.http.server.HttpServerFilter.handleRead(HttpServerFilter.java:218) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.nio.transport.TCPNIOTransport.fireIOEvent(TCPNIOTransport.java:524) ~[?:?]
at org.glassfish.grizzly.strategies.AbstractIOStrategy.fireIOEvent(AbstractIOStrategy.java:89) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.run0(WorkerThreadIOStrategy.java:94) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.access$100(WorkerThreadIOStrategy.java:33) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy$WorkerThreadRunnable.run(WorkerThreadIOStrategy.java:114) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[?:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]

0 Karma

iamryan
Community Manager
Community Manager

Hi @Hossam.Elneily and @Mario.Morelli 

A few of these replies were caught in spam. I just released them, so please continue the conversation!

0 Karma

Hossam_Elneily1
Engager

Thank you Mario for your reply.

So this is not the actual error that makes the agent not respond correctly to the controller 
i found the following error in the log as well.

ERROR GlassfishJerseyInterceptor - Exception detected:
java.lang.NullPointerException: null
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.isDiscoveryEnabled(ATransactionAcceptor.java:615) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.discoverTransactionName(ATransactionAcceptor.java:665) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRsTransactionAcceptor.getNameFromConfiguredNamingScheme(JaxRsTransactionAcceptor.java:93) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointMatchConfigResolver.resolveServiceEndpoint(ServiceEndpointMatchConfigResolver.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.resolveServiceEndPoint(ServiceEndpointDetector.java:184) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.serviceendpoints.ServiceEndpointDetector.identifyEntryServiceEndPoint(ServiceEndpointDetector.java:246) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionAcceptor.acceptAndIdentifyServiceEndPoint(ATransactionAcceptor.java:210) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor._onMethodBeginTracked(ATransactionEntryPointInterceptor.java:390) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.common.ATransactionEntryPointInterceptor.onMethodBeginTracked(ATransactionEntryPointInterceptor.java:167) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.transactionmonitor.webservices.jaxrs.JaxRSIdentificationInterceptor.onMethodBeginTracked(JaxRSIdentificationInterceptor.java:53) ~[appagent.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.services.bciengine.AFastTrackedMethodInterceptor.onMethodBegin(AFastTrackedMethodInterceptor.java:52) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBeginNoReentrantCheck(FastMethodInterceptorDelegatorImpl.java:370) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.kernel.bootimpl.FastMethodInterceptorDelegatorImpl.safeOnMethodBegin(FastMethodInterceptorDelegatorImpl.java:295) ~[appagent-boot.jar:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at com.singularity.ee.agent.appagent.entrypoint.bciengine.FastMethodInterceptorDelegatorBoot.safeOnMethodBegin(FastMethodInterceptorDelegatorBoot.java:52) ~[?:Server Agent #20.10.0.31173 v20.10.0 GA compatible with 4.4.1.0 r29ff7e90931b7171bbfd8336067028701025517a release/20.10.0]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java) ~[?:?]
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[?:?]
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[?:?]
at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[?:?]
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[?:?]
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[?:?]
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680) ~[?:?]
at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:356) ~[?:?]
at org.glassfish.admin.rest.adapter.JerseyContainerCommandService$3.service(JerseyContainerCommandService.java:179) ~[?:?]
at org.glassfish.admin.rest.adapter.RestAdapter.service(RestAdapter.java:189) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper$HttpHandlerCallable.call(ContainerMapper.java:520) ~[?:?]
at com.sun.enterprise.v3.services.impl.ContainerMapper.service(ContainerMapper.java:217) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.runService(HttpHandler.java:182) ~[?:?]
at org.glassfish.grizzly.http.server.HttpHandler.doHandle(HttpHandler.java:156) ~[?:?]
at org.glassfish.grizzly.http.server.HttpServerFilter.handleRead(HttpServerFilter.java:218) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.portunif.PUFilter.handleRead(PUFilter.java:208) ~[?:?]
at org.glassfish.grizzly.filterchain.ExecutorResolver$9.execute(ExecutorResolver.java:95) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeFilter(DefaultFilterChain.java:260) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.executeChainPart(DefaultFilterChain.java:177) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.execute(DefaultFilterChain.java:109) ~[?:?]
at org.glassfish.grizzly.filterchain.DefaultFilterChain.process(DefaultFilterChain.java:88) ~[?:?]
at org.glassfish.grizzly.ProcessorExecutor.execute(ProcessorExecutor.java:53) ~[?:?]
at org.glassfish.grizzly.nio.transport.TCPNIOTransport.fireIOEvent(TCPNIOTransport.java:524) ~[?:?]
at org.glassfish.grizzly.strategies.AbstractIOStrategy.fireIOEvent(AbstractIOStrategy.java:89) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.run0(WorkerThreadIOStrategy.java:94) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy.access$100(WorkerThreadIOStrategy.java:33) ~[?:?]
at org.glassfish.grizzly.strategies.WorkerThreadIOStrategy$WorkerThreadRunnable.run(WorkerThreadIOStrategy.java:114) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[?:?]
at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[?:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221]

Get Updates on the Splunk Community!

Splunk Observability Cloud's AI Assistant in Action Series: Auditing Compliance and ...

This is the third post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how to ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

What You Read The Most: Splunk Lantern’s Most Popular Articles!

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...