AppD Archive

Pb v4.1.4.1 on Tomcat

CommunityUser
Splunk Employee
Splunk Employee

Hi,

I sucessfully installed appdynamics controller (trial version), I can log to http://host:8090/controller

I set up the agent on tomcat, giving the corrrect right access to JAVAAGENT_HOME

In the tomcat catalina.out I have the following message :

Install Directory resolved to[/var/lib/appdynamics]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[DEBUG]: AgentInstallManager - Full Agent Registration Info Resolver is running
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Full Agent Registration Info Resolver using selfService [true]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Full Agent Registration Info Resolver using selfService [true]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Full Agent Registration Info Resolver using application name [tomcat]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Full Agent Registration Info Resolver using tier name [webapps]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Full Agent Registration Info Resolver using node name [null]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[DEBUG]: AgentInstallManager - Full Agent Registration Info Resolver finished running
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Agent runtime directory set to [/var/lib/appdynamics/ver4.1.4.1]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: AgentInstallManager - Agent node directory set to [demo-prod-test]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Using Java Agent Version [Server Agent v4.1.4.1 GA #9445 r8c303cd6d7ab2d54c3fa4812241a95bc5c6e59fa 28-4.1.4.next-build]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Running IBM Java Agent [No]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Java Agent Directory [/var/lib/appdynamics/ver4.1.4.1]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Java Agent AppAgent directory [/var/lib/appdynamics/ver4.1.4.1]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - ####################################################################################
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Java Agent Directory [/var/lib/appdynamics/ver4.1.4.1]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Java Agent AppAgent directory [/var/lib/appdynamics/ver4.1.4.1]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Using Java Agent Version [Server Agent v4.1.4.1 GA #9445 r8c303cd6d7ab2d54c3fa4812241a95bc5c6e59fa 28-4.1.4.next-build]
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - All agent classes have been pre-loaded
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[DEBUG]: JavaAgent - Using Java Version [JAVA_17] for AppDynamics Java Agent
[Thread-0] Mon Sep 28 08:58:14 CEST 2015[INFO]: JavaAgent - Using ASM v5.0.1
Running obfuscated agent
Started AppDynamics Java Agent Successfully.
[Thread-0] Mon Sep 28 08:58:18 CEST 2015[INFO]: JavaAgent - Started AppDynamics Java Agent Successfully.

But in the GUI controller I see nothing.

The JAVAAGENT_HOME logs directory is empty (althought i don't know if i should choose JAVAAGENT_HOME/javaagent.jar and JAVAAGENT_HOME/logs or JAVAAGENT_HOME/ver4.1.4.1/javaagent.jar et JAVAAGENT_HOME/ver4.1.4.1/logs ?)

In controller/logs/server.log I have the following error :

[#|2015-09-28T09:09:43.116+0200|SEVERE|glassfish3.1.2|com.singularity.ee.controller.beans.analytics.account.AnalyticsAccountManagerBean|_ThreadID=135;_ThreadName=Thread-5;|Could not create or update accounts on local analytics instance. Likely some connectivity issue; currently trying to connect with controller key of cfce8e9a-....
com.appdynamics.analytics.shared.rest.exceptions.ClientException: Could not execute request to http://localhost:9080/v1/account/search
        at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.getResponse(GenericHttpRequestBuilder.java:213)

Here is the following output for the commande ps aux|grep javaagent

root      5115 20.8 19.7 3829152 1575236 pts/0 Sl   08:17  12:00 /var/appdynamics/controller/jre/bin/java -cp /var/appdynamics/controller/lib/tools.jar:/var/appdynamics/controller/appserver/glassfish/lib/webservices-tools.jar:/var/appdynamics/controller/appserver/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelOldGC -XX:HeapDumpPath=/var/appdynamics/controller/appserver/glassfish/../../logs -XX:ParallelGCThreads=13 -XX:+DisableExplicitGC -XX:MaxPermSize=256m -XX:PermSize=64m -XX:-OmitStackTraceInFastThrow -XX:NewRatio=2 -XX:SurvivorRatio=10 -XX:-UseAdaptiveSizePolicy -XX:+LogVMOutput -Xms1024m -Xmx1024m -javaagent:/var/appdynamics/controller/appserver/glassfish/lib/monitor/flashlight-agent.jar -javaagent:/var/appdynamics/controller/appserver/glassfish/domains/domain1/appagent/javaagent.jar -server -Dappdynamics.analytics.server.store.url=http://localhost:9080 -Dfelix.fileinstall.disableConfigSave=false -Dproduct.name -Djavax.net.ssl.keyStore=/var/appdynamics/controller/appserver/glassfish/domains/domain1/config/keystore.jks -Dappdynamics.controller.eum.adrumextension.urltemplate=cdn.appdynamics.com -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dappdynamics.controller.home=/var/appdynamics/controller/appserver/glassfish/../.. -Djava.awt.headless=true -Dcom.sun.grizzly.accept.op.batch.size=32 -Dfelix.fileinstall.poll=5000 -Djava.endorsed.dirs=/var/appdynamics/controller/appserver/glassfish/modules/endorsed:/var/appdynamics/controller/appserver/glassfish/lib/endorsed -Dfelix.fileinstall.bundles.startTransient=true -Dappdynamics.controller.hostName=127.0.0.1 -Djavax.net.ssl.trustStore=/var/appdynamics/controller/appserver/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.grizzly.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Dappdynamics.controller.appserver=/var/appdynamics/controller/appserver/glassfish -DANTLR_USE_DIRECT_CLASS_LOADING=true -Djava.security.auth.login.config=/var/appdynamics/controller/appserver/glassfish/domains/domain1/config/login.conf -Dgosh.args=--nointeractive -Dosgi.shell.telnet.maxconn=1 -Dappdynamics.controller.services.hostName=10.0.2.18 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/var/appdynamics/controller/appserver/glassfish/modules/autostart/ -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/var/appdynamics/controller/appserver/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dcom.sun.aas.instanceRoot=/var/appdynamics/controller/appserver/glassfish/domains/domain1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.server.ss.ASQuickStartup=false -Dcom.sun.aas.installRoot=/var/appdynamics/controller/appserver/glassfish -Djava.ext.dirs=/var/appdynamics/controller/jre/lib/ext:/var/appdynamics/controller/jre/jre/lib/ext:/var/appdynamics/controller/appserver/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Dcom.appdynamics.entity.context.logger.xml.config.path=/var/appdynamics/controller/appserver/glassfish/domains/domain1/config/entity-context-logger-config.xml -Dappdynamics.controller.ui.deeplink.url=http://10.0.2.18:8090/controller -Dappdynamics.controller.port=8090 -Dappdynamics.controller.eum.cloud.hostName=agg.eum-appdynamics.com -Dappdynamics.analytics.local.store.url=http://localhost:9080 -Dappdynamics.controller.services.port=8090 -Dappdynamics.controller.eum.analytics.service.hostName=analytics.api.appdynamics.com -Dappdynamics.controller.eum.beacon.hostName=col.eum-appdynamics.com -Djava.library.path=/var/appdynamics/controller/appserver/glassfish/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,4848,,,--secure=false,,,--terse=false,,,--echo=false,,,--interactive=false,,,start-domain,,,--verbose=false,,,--debug=false,,,--domaindir,,,/var/appdynamics/controller/appse
root      9863  0.0  0.0  10432   396 ?        Ss   09:15   0:00 tomcat -pidfile /var/run/tomcat/jsvc.pid -procname tomcat -user tomcat -home /usr/java/latest -classpath /usr/share/tomcat/bin/commons-daemon.jar:/usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar -outfile /var/log/tomcat/catalina.out -errfile /var/log/tomcat/catalina.err -Dcatalina.home=/usr/share/tomcat -Dcatalina.base=/var/lib/tomcat -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties  -XX:PermSize=310m -XX:MaxPermSize=310m -Xmx1296m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/tmp/tomcat8.hprof -javaagent:/var/lib/appdynamics/ver4.1.4.1/javaagent.jar org.apache.catalina.startup.Bootstrap
tomcat    9864  146  2.2 3500816 180996 ?      Sl   09:15   0:10 tomcat -pidfile /var/run/tomcat/jsvc.pid -procname tomcat -user tomcat -home /usr/java/latest -classpath /usr/share/tomcat/bin/commons-daemon.jar:/usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar -outfile /var/log/tomcat/catalina.out -errfile /var/log/tomcat/catalina.err -Dcatalina.home=/usr/share/tomcat -Dcatalina.base=/var/lib/tomcat -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties  -XX:PermSize=310m -XX:MaxPermSize=310m -Xmx1296m 
-javaagent:/var/lib/appdynamics/ver4.1.4.1/javaagent.jar org.apache.catalina.startup.Bootstrap

Thanks for you help

Philippe

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I move a little foward, I had to add set <node-name>node-demo</node-name> in controller-config in order to have logs in

javaagent_home/logs/node-demo

I setup debug level to javaagent_home/conf/logging/log4j.xml and get the following trace in javaagent_home/logs/node-demo/agent.2015_09_28__09_44_27.0.log

:

[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,536  INFO ConfigurationChannel - Detected node meta info: [Name:ProcessID, Value:11808, Name:appdynamics.ip.addresses, Value:fe80:0:0:0:f816:3eff:fe1b:8178%2,10.0.2.18, Name:supportsDevMode, Value:true]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,536  INFO ConfigurationChannel - Sending Registration request with: Application Name [tomcat], Tier Name [webapps], Node Name [node-demo], Host Name [demo-prod-test] Node Unique Local ID [node-demo], Version [Server Agent v4.1.4.1 GA #9445 r8c303cd6d7ab2d54c3fa4812241a95bc5c6e59fa 28-4.1.4.next-build]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,541 DEBUG HTTPLogger - CookieSpec selected: best-match
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,542 DEBUG HTTPLogger - Connection request: [route: {}->http://10.0.2.18:8090][total kept alive: 0; route allocated: 0 of 4; total allocated: 0 of 20]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,542 DEBUG HTTPLogger - Connection leased: [id: 3][route: {}->http://10.0.2.18:8090][total kept alive: 0; route allocated: 1 of 4; total allocated: 1 of 20]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,542 DEBUG HTTPLogger - Opening connection {}->http://10.0.2.18:8090
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,543 DEBUG HTTPLogger - Connecting to /10.0.2.18:8090
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,544 DEBUG HTTPLogger - Connection established 10.0.2.18:33467<->10.0.2.18:8090
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,544 DEBUG HTTPLogger - Executing request POST /controller/instance/0/applicationConfiguration HTTP/1.1
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - Target auth state: FAILURE
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - Proxy auth state: UNCHALLENGED
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> POST /controller/instance/0/applicationConfiguration HTTP/1.1
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> Content-Length: 9078
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> Content-Type: application/singularity-native-serializer
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> Host: 10.0.2.18:8090
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> Connection: Keep-Alive
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> User-Agent: Apache-HttpClient/4.3.3 (java 1.5)
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,545 DEBUG HTTPLogger - http-outgoing-3 >> Accept-Encoding: gzip,deflate
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "POST /controller/instance/0/applicationConfiguration HTTP/1.1[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "Content-Length: 9078[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "Content-Type: application/singularity-native-serializer[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "Host: 10.0.2.18:8090[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "Connection: Keep-Alive[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "User-Agent: Apache-HttpClient/4.3.3 (java 1.5)[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,546 DEBUG HTTPLogger - http-outgoing-3 >> "Accept-Encoding: gzip,deflate[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "HTTP/1.1 401 Unauthorized[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "X-Powered-By: Servlet/3.0 JSP/2.2 (GlassFish Server Open Source Edition 3.1.2.2 Java/Oracle Corporation/1.7)[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "WWW-Authenticate: Basic realm="controller_realm"[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "Content-Type: text/html[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "Content-Length: 973[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "Date: Mon, 28 Sep 2015 07:47:29 GMT[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "[\r][\n]"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,549 DEBUG HTTPLogger - http-outgoing-3 << "<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>Error report</title><style type="text/css"><!--H1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} H2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} H3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} BODY {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} B {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} P {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;}A {color : black;}HR {color : #525D76;}--></style> </head><body><h1>HTTP Status 401 - </h1><hr/><p><b>type</b> Status report</p><p><b>message</b></p><p><b>description</b>This request requires HTTP authentication ().</p><hr/></body></html>"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << HTTP/1.1 401 Unauthorized
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << X-Powered-By: Servlet/3.0 JSP/2.2 (GlassFish Server Open Source Edition 3.1.2.2 Java/Oracle Corporation/1.7)
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << WWW-Authenticate: Basic realm="controller_realm"
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << Content-Type: text/html
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << Content-Length: 973
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - http-outgoing-3 << Date: Mon, 28 Sep 2015 07:47:29 GMT
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - Connection can be kept alive indefinitely
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - Authentication required
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,550 DEBUG HTTPLogger - 10.0.2.18:8090 requested authentication
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,551 ERROR ConfigurationChannel - HTTP Request failed: HTTP/1.1 401 Unauthorized
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,551 DEBUG HTTPLogger - http-outgoing-3: Shutdown connection
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,551 DEBUG HTTPLogger - Connection discarded
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,552 DEBUG HTTPLogger - http-outgoing-3: Close connection
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,552 DEBUG HTTPLogger - Connection released: [id: 3][route: {}->http://10.0.2.18:8090][total kept alive: 0; route allocated: 0 of 4; total allocated: 0 of 20]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,552  WARN ConfigurationChannel - Could not connect to the controller/invalid response from controller, cannot get initialization information, controller host [10.0.2.18], port[8090], exception [null]
[AD Thread Pool-Global1] 28 Sep 2015 09:47:29,552 ERROR ConfigurationChannel - Exception: NULL

How can I set the credentials I set in the controller config so that the agent can talk with the controller ?

What is this NULL exception ?

Regards,

Philippe

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Ok I finally get it worked by setting the correct <account-access-key> in controller-config.xml

Consider this message closed

0 Karma
Get Updates on the Splunk Community!

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...

Integrating Splunk Search API and Quarto to Create Reproducible Investigation ...

 Splunk is More Than Just the Web Console For Digital Forensics and Incident Response (DFIR) practitioners, ...

Congratulations to the 2025-2026 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...