AppD Archive

Controller NOT starting properly. seems to starting with null host and port and failing

CommunityUser
Splunk Employee
Splunk Employee

com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

After starting the controller from INSTALL_HOME/bin/startController, the database starts fine but the controller starts with arguments which appear to not having any values as above.

Subsequently in the server.log, I see that there is a connect refused on port 9080.

What is possibly wrong?

 Someone please help.

-Thanks

vsjoshi

#|2016-01-25T05:30:13.214-0800|SEVERE|glassfish3.1.2|com.singularity.ee.controller.beans.analytics.account.AnalyticsAccountManagerBean|_ThreadID=144;_ThreadName=Thread-5;|Could not create or update accounts on local analytics instance. Likely some connectivity issue; currently trying to connect with controller key of f3494b3b-....
com.appdynamics.analytics.shared.rest.exceptions.ClientException: Could not execute request to http://localhost:9080/v1/account/search
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.getResponse(GenericHttpRequestBuilder.java:213)
at com.appdynamics.analytics.shared.rest.client.utils.GenericHttpRequestBuilder.executeAndReturnRawResponseString(GenericHttpRequestBuilder.java:227)
at com.appdynamics.analytics.shared.rest.client.auth.DefaultAccountServiceClient.getAccountConfigurations(DefaultAccountServiceClient.java:125)

0 Karma

Davide_Franzino
Explorer

seems somethoing on analytics services config

to start controller manually and not all dependent service go Controlloe_HOME/bin

run 

./controller.sh start-db

./controller.sh start-appserver

./controller.sh start-reporting-service

check server.log 

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I did try that. But Controller still fails to start properly.

Check the last arguments in cmd-line that get passed to Controller. They look suspect.

domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

/opt/AppDController/Controller/jre/bin/java -cp /opt/AppDController/Controller/lib/tools.jar:/opt/AppDController/Controller/appserver/glassfish/lib/webservices-tools.jar:/opt/AppDController/Controller/appserver/glassfish/modules/glassfish.jar -XX:+UnlockDiagnosticVMOptions -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelOldGC -XX:HeapDumpPath=/opt/AppDController/Controller/appserver/glassfish/../../logs -XX:ParallelGCThreads=13 -XX:+DisableExplicitGC -XX:MaxPermSize=256m -XX:PermSize=64m -XX:-OmitStackTraceInFastThrow -XX:NewRatio=2 -XX:SurvivorRatio=10 -XX:-UseAdaptiveSizePolicy -XX:+LogVMOutput -Xms1536m -Xmx1536m -javaagent:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/appagent/javaagent.jar -server -javaagent:/opt/AppDController/Controller/appserver/glassfish/lib/monitor/flashlight-agent.jar -Dappdynamics.analytics.server.store.url=http://localhost:9080 -Dfelix.fileinstall.disableConfigSave=false -Dproduct.name -Djavax.net.ssl.keyStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/keystore.jks -Dappdynamics.controller.eum.adrumextension.urltemplate=cdn.appdynamics.com -Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dappdynamics.controller.home=/opt/AppDController/Controller/appserver/glassfish/../.. -Djava.awt.headless=true -Dcom.sun.grizzly.accept.op.batch.size=32 -Dfelix.fileinstall.poll=5000 -Djava.endorsed.dirs=/opt/AppDController/Controller/appserver/glassfish/modules/endorsed:/opt/AppDController/Controller/appserver/glassfish/lib/endorsed -Dfelix.fileinstall.bundles.startTransient=true -Dappdynamics.controller.hostName=127.0.0.1 -Djavax.net.ssl.trustStore=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/cacerts.jks -Dcom.sun.grizzly.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dcom.sun.enterprise.security.httpsOutboundKeyAlias=s1as -Dappdynamics.controller.appserver=/opt/AppDController/Controller/appserver/glassfish -DANTLR_USE_DIRECT_CLASS_LOADING=true -Djava.security.auth.login.config=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/login.conf -Dgosh.args=--nointeractive -Dappdynamics.controller.email=help@appdynamics.com -Dosgi.shell.telnet.maxconn=1 -Dappdynamics.controller.services.hostName=10.95.121.136 -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver -Dfelix.fileinstall.dir=/opt/AppDController/Controller/appserver/glassfish/modules/autostart/ -Dosgi.shell.telnet.port=6666 -Djava.security.policy=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/server.policy -Dfelix.fileinstall.log.level=2 -Dcom.sun.aas.instanceRoot=/opt/AppDController/Controller/appserver/glassfish/domains/domain1 -Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory -Dosgi.shell.telnet.ip=127.0.0.1 -Dcom.sun.enterprise.server.ss.ASQuickStartup=false -Dcom.sun.aas.installRoot=/opt/AppDController/Controller/appserver/glassfish -Dappdynamics.controller.smtp.relay.port=25 -Djava.ext.dirs=/opt/AppDController/Controller/jre/lib/ext:/opt/AppDController/Controller/jre/jre/lib/ext:/opt/AppDController/Controller/appserver/glassfish/domains/domain1/lib/ext -Dfelix.fileinstall.bundles.new.start=true -Dcom.appdynamics.entity.context.logger.xml.config.path=/opt/AppDController/Controller/appserver/glassfish/domains/domain1/config/entity-context-logger-config.xml -Dappdynamics.controller.ui.deeplink.url=http://10.95.121.136:8090/controller -Dappdynamics.controller.port=8090 -Dappdynamics.controller.eum.cloud.hostName=agg.eum-appdynamics.com -Dappdynamics.analytics.local.store.url=http://localhost:9080 -Dappdynamics.controller.services.port=8090 -Dappdynamics.controller.eum.analytics.service.hostName=analytics.api.appdynamics.com -Dappdynamics.controller.eum.beacon.hostName=col.eum-appdynamics.com -Djava.library.path=/opt/AppDController/Controller/appserver/glassfish/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib com.sun.enterprise.glassfish.bootstrap.ASMain -domainname domain1 -asadmin-args --host,,,localhost,,,--port,,,

0 Karma

Davide_Franzino
Explorer

sotty my mistake

port 9080 is user from analytics-service and you have default property in your domain.xml

-Dappdynamics.analytics.local.store.url=http://localhost:9080

before start controller try to start manually analytics service tih controller.sh and post error if you have it

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

There is no option to start analytics service separately. Is it events-service?

usage: controller.sh [start|stop|start-appserver|stop-appserver|start-db|stop-db|start-events-service|stop-events-service|start-reporting-service|stop-reporting-service|login-db|reset-ejb-jms-tables|recreate-jms-tables|enable-http-listeners|disable-http-listeners|patch-upgrade /path/to/controller_patch_upgrade.zip|zip-logs|capture-diagnostic-information|enable-token-auth-module|disable-token-auth-module]

0 Karma

Davide_Franzino
Explorer

sure event-service open port 9080

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Finally turned out to be a licensing issue. Upgraded the license and Controller is coming up fine.

Thanks

0 Karma
Get Updates on the Splunk Community!

Index This | Why did the turkey cross the road?

November 2025 Edition  Hayyy Splunk Education Enthusiasts and the Eternally Curious!   We’re back with this ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Feel the Splunk Love: Real Stories from Real Customers

Hello Splunk Community,    What’s the best part of hearing how our customers use Splunk? Easy: the positive ...