AppD Archive

Controller NOT starting properly. seems to starting with null host and port and failing

CommunityUser
Splunk Employee
Splunk Employee

com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

After starting the controller from INSTALL_HOME/bin/startController, the database starts fine but the controller starts with arguments which appear to not having any values as above.

Subsequently in the server.log, I see that there is a connect refused on port 9080.

What is possibly wrong?

 Someone please help.

-Thanks

vsjoshi

#|2016-01-25T05:30:13.214-0800|SEVERE|glassfish3.1.2|com.singularity.ee.controller.beans.analytics.account.AnalyticsAccountManagerBean|_ThreadID=144;_ThreadName=Thread-5;|Could not create or update accounts on local analytics instance. Likely some connectivity issue; currently trying to connect with controller key of f3494b3b-....
com.appdynamics.analytics.shared.rest.exceptions.ClientException: Could not execute request to http://localhost:9080/v1/account/search
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.getResponse(GenericHttpRequestBuilder.java:213)
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.executeAndReturnRawResponseString(GenericHttpRequestBuilder.java:227)
at com.appdynamics.analytics.shared.rest.client.auth.DefaultAccountServiceClient.getAccountConfigurations(DefaultAccountServiceClient.java:125)

0 Karma

Davide_Franzino
Explorer

seems somethoing on analytics services config

to start controller manually and not all dependent service go Controlloe_HOME/bin

run 

./controller.sh start-db

./controller.sh start-appserver

./controller.sh start-reporting-service

check server.log 

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I did try that. But Controller still fails to start properly.

Check the last arguments in cmd-line that get passed to Controller. They look suspect.

domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

/opt/AppDController/Controller/jre/bin/java -cp /opt/AppDController/Controller/lib/tools.jar:/opt/AppDController/Controller/appserver/glassfish/lib/webservices-tools.jar:/opt/AppDController/Controller/appserver/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelOldGC -XX:HeapDumpPath=/opt/AppDController/Controller/appserver/glassfish/../../logs -XX:ParallelGCThreads=13 -XX:+DisableExplicitGC -XX:MaxPermSize=256m -XX:PermSize=64m -XX:-OmitStackTraceInFastThrow -XX:NewRatio=2 -XX:SurvivorRatio=10 -XX:-UseAdaptiveSizePolicy -XX:+LogVMOutput -Xms1536m -Xmx1536m -javaagent:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/appagent/javaagent.jar -server -javaagent:/opt/AppDController/Controller/appserver/glassfish/lib/monitor/flashlight-agent.jar -Dappdynamics.analytics.server.store.url=http://localhost:9080 -Dfelix.fileinstall.disableConfigSave=false -Dproduct.name -Djavax.net.ssl.keyStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/keystore.jks -Dappdynamics.controller.eum.adrumextension.urltemplate=cdn.appdynamics.com -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dappdynamics.controller.home=/opt/AppDController/Controller/appserver/glassfish/../.. -Djava.awt.headless=true -Dcom.sun.grizzly.accept.op.batch.size=32 -Dfelix.fileinstall.poll=5000 -Djava.endorsed.dirs=/opt/AppDController/Controller/appserver/glassfish/modules/endorsed:/opt/AppDController/Controller/appserver/glassfish/lib/endorsed -Dfelix.fileinstall.bundles.startTransient=true -Dappdynamics.controller.hostName=127.0.0.1 -Djavax.net.ssl.trustStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.grizzly.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Dappdynamics.controller.appserver=/opt/AppDController/Controller/appserver/glassfish -DANTLR_USE_DIRECT_CLASS_LOADING=true -Djava.security.auth.login.config=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/login.conf -Dgosh.args=--nointeractive -Dappdynamics.controller.email=help@appdynamics.com -Dosgi.shell.telnet.maxconn=1 -Dappdynamics.controller.services.hostName=10.95.121.136 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/opt/AppDController/Controller/appserver/glassfish/modules/autostart/ -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dcom.sun.aas.instanceRoot=/opt/AppDController/Controller/appserver/glassfish/domains/domain1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.server.ss.ASQuickStartup=false -Dcom.sun.aas.installRoot=/opt/AppDController/Controller/appserver/glassfish -Dappdynamics.controller.smtp.relay.port=25 -Djava.ext.dirs=/opt/AppDController/Controller/jre/lib/ext:/opt/AppDController/Controller/jre/jre/lib/ext:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Dcom.appdynamics.entity.context.logger.xml.config.path=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/entity-context-logger-config.xml -Dappdynamics.controller.ui.deeplink.url=http://10.95.121.136:8090/controller -Dappdynamics.controller.port=8090 -Dappdynamics.controller.eum.cloud.hostName=agg.eum-appdynamics.com -Dappdynamics.analytics.local.store.url=http://localhost:9080 -Dappdynamics.controller.services.port=8090 -Dappdynamics.controller.eum.analytics.service.hostName=analytics.api.appdynamics.com -Dappdynamics.controller.eum.beacon.hostName=col.eum-appdynamics.com -Djava.library.path=/opt/AppDController/Controller/appserver/glassfish/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

0 Karma

Davide_Franzino
Explorer

sotty my mistake

port 9080 is user from analytics-service and you have default property in your domain.xml

-Dappdynamics.analytics.local.store.url=http://localhost:9080

before start controller try to start manually analytics service tih controller.sh and post error if you have it

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

There is no option to start analytics service separately. Is it events-service?

usage: controller.sh [start|stop|start-appserver|stop-appserver|start-db|stop-db|start-events-service|stop-events-service|start-reporting-service|stop-reporting-service|login-db|reset-ejb-jms-tables|recreate-jms-tables|enable-http-listeners|disable-http-listeners|patch-upgrade /path/to/controller_patch_upgrade.zip|zip-logs|capture-diagnostic-information|enable-token-auth-module|disable-token-auth-module]

0 Karma

Davide_Franzino
Explorer

sure event-service open port 9080

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Finally turned out to be a licensing issue. Upgraded the license and Controller is coming up fine.

Thanks

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...