JBO-27122 errors when using AppDynamics

[Diego_Garibotti]

Hello,

After updating WebLogic from version 12.1 to 12.2.1.3.0 and Java from 6 to 8 (1.8.0_191), we start getting some "JBO-27122: SQL error during statement preparation" errors.
After some investigation we remove AppDynamics from our start scripts and this error disappear.
We are using AppDynamics agent version 4.5.8.25346.
Can you please assist with this issue?

Please see error below:

2019-12-16 21:01:32.436 ERROR [faultQuartzScheduler_Worker-0] au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean : Caught oracle.jbo.SQLStmtException
oracle.jbo.SQLStmtException: JBO-27122: SQL error during statement preparation. Statement: SELECT ParentTitleLot.REQUEST_NUMBER, ParentTitleLot.PI_TYPE, ParentTitleLot.PI_PARCEL,
ParentTitleLot.POLYGON_NUMBER, ParentTitleLot.REGISTER_ID, ParentTitleLot.STRATA_LOT_NUMBER, ParentTitleLot.TITLE_PREFIX, ParentTitleLot.TITLE_VOLUME_NUMBER,
ParentTitleLot.TITLE_FOLIO_NUMBER, ParentTitleLot.TITLE_SUFFIX, ParentTitleLot.PARCEL_NUMBER FROM EAS.PARENT_TITLE_LOT ParentTitleLot WHERE (ParentTitleLot.REQUEST_NUMBER = :1)
at oracle.jbo.server.QueryCollection.buildResultSet(QueryCollection.java:644)
at oracle.jbo.server.QueryCollection.executeQuery(QueryCollection.java:521)
at oracle.jbo.server.ViewObjectImpl.executeQueryForCollection(ViewObjectImpl.java:3200)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:597)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:574)
at oracle.jbo.server.ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2548)
at oracle.jbo.server.ViewRowSetIteratorImpl.hasNext(ViewRowSetIteratorImpl.java:1705)
at oracle.jbo.server.ViewRowSetImpl.hasNext(ViewRowSetImpl.java:2537)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2961)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2807)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadRequest(EasRequestProcessBean.java:363)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.loadRequest(Unknown Source)
at au.gov.wa.dola.eas2.businesszone.service.eas.CmdLoadRequest.execute(CmdLoadRequest.java:57)
at au.gov.wa.dola.framework.businesszone.service.RequestController.execute(RequestController.java:49)
at au.gov.wa.dola.framework.businesszone.service.ServiceRequestHelper.execute(ServiceRequestHelper.java:44)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.getAdviceOfSale(EmailAgentSummariesBean.java:457)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailSummariesToAgent(EmailAgentSummariesBean.java:82)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailAgentSummaries(EmailAgentSummariesBean.java:190)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.emailAgentSummaries(Unknown Source)
at au.gov.wa.dola.eas2.scheduler.tasks.EmailAgentSummariesTaskRunner.execute(EmailAgentSummariesTaskRunner.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:283)
at org.springframework.scheduling.quartz.MethodInvokingJobDetailFactoryBean$MethodInvokingJob.executeInternal(MethodInvokingJobDetailFactoryBean.java:272)
at org.springframework.scheduling.quartz.QuartzJobBean.execute(QuartzJobBean.java:86)
at org.quartz.core.JobRunShell.run(JobRunShell.java:203)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:520)
## Detail 0 ##
java.sql.SQLException: Statement cancelled, probably by transaction timing out
at weblogic.jdbc.wrapper.Statement.postInvocationHandler(Statement.java:64)
at weblogic.jdbc.wrapper.PreparedStatement_oracle_jdbc_driver_OraclePreparedStatementWrapper.setMaxRows(Unknown Source)
at oracle.jbo.server.QueryCollection.buildResultSet(QueryCollection.java:582)
at oracle.jbo.server.QueryCollection.executeQuery(QueryCollection.java:521)
at oracle.jbo.server.ViewObjectImpl.executeQueryForCollection(ViewObjectImpl.java:3200)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:597)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:574)
at oracle.jbo.server.ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2548)
at oracle.jbo.server.ViewRowSetIteratorImpl.hasNext(ViewRowSetIteratorImpl.java:1705)
at oracle.jbo.server.ViewRowSetImpl.hasNext(ViewRowSetImpl.java:2537)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2961)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2807)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadRequest(EasRequestProcessBean.java:363)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.loadRequest(Unknown Source)
at au.gov.wa.dola.eas2.businesszone.service.eas.CmdLoadRequest.execute(CmdLoadRequest.java:57)
at au.gov.wa.dola.framework.businesszone.service.RequestController.execute(RequestController.java:49)
at au.gov.wa.dola.framework.businesszone.service.ServiceRequestHelper.execute(ServiceRequestHelper.java:44)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.getAdviceOfSale(EmailAgentSummariesBean.java:457)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailSummariesToAgent(EmailAgentSummariesBean.java:82)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailAgentSummaries(EmailAgentSummariesBean.java:190)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.emailAgentSummaries(Unknown Source)
at au.gov.wa.dola.eas2.scheduler.tasks.EmailAgentSummariesTaskRunner.execute(EmailAgentSummariesTaskRunner.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:283)
at org.springframework.scheduling.quartz.MethodInvokingJobDetailFactoryBean$MethodInvokingJob.executeInternal(MethodInvokingJobDetailFactoryBean.java:272)
at org.springframework.scheduling.quartz.QuartzJobBean.execute(QuartzJobBean.java:86)
at org.quartz.core.JobRunShell.run(JobRunShell.java:203)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:520)
2019-12-16 21:01:32.439 ERROR [faultQuartzScheduler_Worker-0] au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean : [java.sql.SQLException: Statement cancelled, probably by transaction timing out]

[Allan_Schiebold]

Hi. There have been many enhancements around compatibility in agent versions since 4.5.8. Please update to the latest java agent from download.appdynamics.com. Let us know how that works out. Thanks!

[Diego_Garibotti]

Hi Allan,

After updating to the last agent version, it still showing the JBO-27122 errors.

This errors just started after we update the weblogic.

Any thoughts on what else we can do to fix this issue?

Thanks

[Allan_Schiebold]

Thanks for the update. I noticed in the docs that it says:

If you have enabled Java 2 security on your WebLogic server, you need to add the following code block to the weblogic.policy file:

grant codeBase "file:/<agent_home>/-"
{ permission java.security.AllPermission; };

If you don't already have that change made in the policy file, I'm wondering if the update on weblogic enabled Java 2 Security. Can you let us know if you're using Java 2 Security? If so, make sure the policy file has been changed with the above config. 

Thanks!

[Diego_Garibotti]

Hi Allan,

Thanks for your reply.

I have just add the code block to the weblogic.policy file.

I will keep monitoring the server for a week or so and I will let you know if this config change 

will sort this issue out.

Thanks,

Diego

[Diego_Garibotti]

Hi Allan,

After the changes in the weblogic.policy file the error persists.

Any other ideas?

Thanks,

Diego

[iamryan · Accepted solution]

Hi Diego, 

At this point, we recommend opening a support ticket here. https://www.appdynamics.com/support

[Diego_Garibotti]

Hi,

I have updated to java agent 4.5.19.29609 in test environment.

I will keep monitoring it to check if this will solve the JBO-27122 issue.

Thanks