AppD Archive

Controller NOT starting properly. seems to starting with null host and port and failing

CommunityUser
Splunk Employee
Splunk Employee

com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

After starting the controller from INSTALL_HOME/bin/startController, the database starts fine but the controller starts with arguments which appear to not having any values as above.

Subsequently in the server.log, I see that there is a connect refused on port 9080.

What is possibly wrong?

 Someone please help.

-Thanks

vsjoshi

#|2016-01-25T05:30:13.214-0800|SEVERE|glassfish3.1.2|com.singularity.ee.controller.beans.analytics.account.AnalyticsAccountManagerBean|_ThreadID=144;_ThreadName=Thread-5;|Could not create or update accounts on local analytics instance. Likely some connectivity issue; currently trying to connect with controller key of f3494b3b-....
com.appdynamics.analytics.shared.rest.exceptions.ClientException: Could not execute request to http://localhost:9080/v1/account/search
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.getResponse(GenericHttpRequestBuilder.java:213)
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.executeAndReturnRawResponseString(GenericHttpRequestBuilder.java:227)
at com.appdynamics.analytics.shared.rest.client.auth.DefaultAccountServiceClient.getAccountConfigurations(DefaultAccountServiceClient.java:125)

0 Karma

Davide_Franzino
Explorer

seems somethoing on analytics services config

to start controller manually and not all dependent service go Controlloe_HOME/bin

run 

./controller.sh start-db

./controller.sh start-appserver

./controller.sh start-reporting-service

check server.log 

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I did try that. But Controller still fails to start properly.

Check the last arguments in cmd-line that get passed to Controller. They look suspect.

domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

/opt/AppDController/Controller/jre/bin/java -cp /opt/AppDController/Controller/lib/tools.jar:/opt/AppDController/Controller/appserver/glassfish/lib/webservices-tools.jar:/opt/AppDController/Controller/appserver/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelOldGC -XX:HeapDumpPath=/opt/AppDController/Controller/appserver/glassfish/../../logs -XX:ParallelGCThreads=13 -XX:+DisableExplicitGC -XX:MaxPermSize=256m -XX:PermSize=64m -XX:-OmitStackTraceInFastThrow -XX:NewRatio=2 -XX:SurvivorRatio=10 -XX:-UseAdaptiveSizePolicy -XX:+LogVMOutput -Xms1536m -Xmx1536m -javaagent:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/appagent/javaagent.jar -server -javaagent:/opt/AppDController/Controller/appserver/glassfish/lib/monitor/flashlight-agent.jar -Dappdynamics.analytics.server.store.url=http://localhost:9080 -Dfelix.fileinstall.disableConfigSave=false -Dproduct.name -Djavax.net.ssl.keyStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/keystore.jks -Dappdynamics.controller.eum.adrumextension.urltemplate=cdn.appdynamics.com -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dappdynamics.controller.home=/opt/AppDController/Controller/appserver/glassfish/../.. -Djava.awt.headless=true -Dcom.sun.grizzly.accept.op.batch.size=32 -Dfelix.fileinstall.poll=5000 -Djava.endorsed.dirs=/opt/AppDController/Controller/appserver/glassfish/modules/endorsed:/opt/AppDController/Controller/appserver/glassfish/lib/endorsed -Dfelix.fileinstall.bundles.startTransient=true -Dappdynamics.controller.hostName=127.0.0.1 -Djavax.net.ssl.trustStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.grizzly.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Dappdynamics.controller.appserver=/opt/AppDController/Controller/appserver/glassfish -DANTLR_USE_DIRECT_CLASS_LOADING=true -Djava.security.auth.login.config=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/login.conf -Dgosh.args=--nointeractive -Dappdynamics.controller.email=help@appdynamics.com -Dosgi.shell.telnet.maxconn=1 -Dappdynamics.controller.services.hostName=10.95.121.136 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/opt/AppDController/Controller/appserver/glassfish/modules/autostart/ -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dcom.sun.aas.instanceRoot=/opt/AppDController/Controller/appserver/glassfish/domains/domain1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.server.ss.ASQuickStartup=false -Dcom.sun.aas.installRoot=/opt/AppDController/Controller/appserver/glassfish -Dappdynamics.controller.smtp.relay.port=25 -Djava.ext.dirs=/opt/AppDController/Controller/jre/lib/ext:/opt/AppDController/Controller/jre/jre/lib/ext:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Dcom.appdynamics.entity.context.logger.xml.config.path=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/entity-context-logger-config.xml -Dappdynamics.controller.ui.deeplink.url=http://10.95.121.136:8090/controller -Dappdynamics.controller.port=8090 -Dappdynamics.controller.eum.cloud.hostName=agg.eum-appdynamics.com -Dappdynamics.analytics.local.store.url=http://localhost:9080 -Dappdynamics.controller.services.port=8090 -Dappdynamics.controller.eum.analytics.service.hostName=analytics.api.appdynamics.com -Dappdynamics.controller.eum.beacon.hostName=col.eum-appdynamics.com -Djava.library.path=/opt/AppDController/Controller/appserver/glassfish/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

0 Karma

Davide_Franzino
Explorer

sotty my mistake

port 9080 is user from analytics-service and you have default property in your domain.xml

-Dappdynamics.analytics.local.store.url=http://localhost:9080

before start controller try to start manually analytics service tih controller.sh and post error if you have it

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

There is no option to start analytics service separately. Is it events-service?

usage: controller.sh [start|stop|start-appserver|stop-appserver|start-db|stop-db|start-events-service|stop-events-service|start-reporting-service|stop-reporting-service|login-db|reset-ejb-jms-tables|recreate-jms-tables|enable-http-listeners|disable-http-listeners|patch-upgrade /path/to/controller_patch_upgrade.zip|zip-logs|capture-diagnostic-information|enable-token-auth-module|disable-token-auth-module]

0 Karma

Davide_Franzino
Explorer

sure event-service open port 9080

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Finally turned out to be a licensing issue. Upgraded the license and Controller is coming up fine.

Thanks

0 Karma
Get Updates on the Splunk Community!

See just what you’ve been missing | Observability tracks at Splunk University

Looking to sharpen your observability skills so you can better understand how to collect and analyze data from ...

Weezer at .conf25? Say it ain’t so!

Hello Splunkers, The countdown to .conf25 is on-and we've just turned up the volume! We're thrilled to ...

How SC4S Makes Suricata Logs Ingestion Simple

Network security monitoring has become increasingly critical for organizations of all sizes. Splunk has ...