JBO-27122 errors when using AppDynamics

Diego_Garibotti — Sun, 15 Mar 2020 23:50:55 GMT

Hello,

After updating WebLogic from version 12.1 to 12.2.1.3.0 and Java from 6 to 8 (1.8.0_191), we start getting some "JBO-27122: SQL error during statement preparation" errors.
After some investigation we remove AppDynamics from our start scripts and this error disappear.
We are using AppDynamics agent version 4.5.8.25346.
Can you please assist with this issue?

Please see error below:

2019-12-16 21:01:32.436 ERROR [faultQuartzScheduler_Worker-0] au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean : Caught oracle.jbo.SQLStmtException
oracle.jbo.SQLStmtException: JBO-27122: SQL error during statement preparation. Statement: SELECT ParentTitleLot.REQUEST_NUMBER, ParentTitleLot.PI_TYPE, ParentTitleLot.PI_PARCEL,
ParentTitleLot.POLYGON_NUMBER, ParentTitleLot.REGISTER_ID, ParentTitleLot.STRATA_LOT_NUMBER, ParentTitleLot.TITLE_PREFIX, ParentTitleLot.TITLE_VOLUME_NUMBER,
ParentTitleLot.TITLE_FOLIO_NUMBER, ParentTitleLot.TITLE_SUFFIX, ParentTitleLot.PARCEL_NUMBER FROM EAS.PARENT_TITLE_LOT ParentTitleLot WHERE (ParentTitleLot.REQUEST_NUMBER = :1)
at oracle.jbo.server.QueryCollection.buildResultSet(QueryCollection.java:644)
at oracle.jbo.server.QueryCollection.executeQuery(QueryCollection.java:521)
at oracle.jbo.server.ViewObjectImpl.executeQueryForCollection(ViewObjectImpl.java:3200)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:597)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:574)
at oracle.jbo.server.ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2548)
at oracle.jbo.server.ViewRowSetIteratorImpl.hasNext(ViewRowSetIteratorImpl.java:1705)
at oracle.jbo.server.ViewRowSetImpl.hasNext(ViewRowSetImpl.java:2537)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2961)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2807)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadRequest(EasRequestProcessBean.java:363)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.loadRequest(Unknown Source)
at au.gov.wa.dola.eas2.businesszone.service.eas.CmdLoadRequest.execute(CmdLoadRequest.java:57)
at au.gov.wa.dola.framework.businesszone.service.RequestController.execute(RequestController.java:49)
at au.gov.wa.dola.framework.businesszone.service.ServiceRequestHelper.execute(ServiceRequestHelper.java:44)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.getAdviceOfSale(EmailAgentSummariesBean.java:457)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailSummariesToAgent(EmailAgentSummariesBean.java:82)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailAgentSummaries(EmailAgentSummariesBean.java:190)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.emailAgentSummaries(Unknown Source)
at au.gov.wa.dola.eas2.scheduler.tasks.EmailAgentSummariesTaskRunner.execute(EmailAgentSummariesTaskRunner.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:283)
at org.springframework.scheduling.quartz.MethodInvokingJobDetailFactoryBean$MethodInvokingJob.executeInternal(MethodInvokingJobDetailFactoryBean.java:272)
at org.springframework.scheduling.quartz.QuartzJobBean.execute(QuartzJobBean.java:86)
at org.quartz.core.JobRunShell.run(JobRunShell.java:203)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:520)
## Detail 0 ##
java.sql.SQLException: Statement cancelled, probably by transaction timing out
at weblogic.jdbc.wrapper.Statement.postInvocationHandler(Statement.java:64)
at weblogic.jdbc.wrapper.PreparedStatement_oracle_jdbc_driver_OraclePreparedStatementWrapper.setMaxRows(Unknown Source)
at oracle.jbo.server.QueryCollection.buildResultSet(QueryCollection.java:582)
at oracle.jbo.server.QueryCollection.executeQuery(QueryCollection.java:521)
at oracle.jbo.server.ViewObjectImpl.executeQueryForCollection(ViewObjectImpl.java:3200)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:597)
at oracle.jbo.server.ViewRowSetImpl.execute(ViewRowSetImpl.java:574)
at oracle.jbo.server.ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2548)
at oracle.jbo.server.ViewRowSetIteratorImpl.hasNext(ViewRowSetIteratorImpl.java:1705)
at oracle.jbo.server.ViewRowSetImpl.hasNext(ViewRowSetImpl.java:2537)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2961)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadAdviceOfSale(EasRequestProcessBean.java:2807)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean.loadRequest(EasRequestProcessBean.java:363)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcess_3xxnzk_ELOImpl.loadRequest(Unknown Source)
at au.gov.wa.dola.eas2.businesszone.service.eas.CmdLoadRequest.execute(CmdLoadRequest.java:57)
at au.gov.wa.dola.framework.businesszone.service.RequestController.execute(RequestController.java:49)
at au.gov.wa.dola.framework.businesszone.service.ServiceRequestHelper.execute(ServiceRequestHelper.java:44)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.getAdviceOfSale(EmailAgentSummariesBean.java:457)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailSummariesToAgent(EmailAgentSummariesBean.java:82)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailAgentSummariesBean.emailAgentSummaries(EmailAgentSummariesBean.java:190)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.__WL_invoke(Unknown Source)
at weblogic.ejb.container.internal.SessionLocalMethodInvoker.invoke(SessionLocalMethodInvoker.java:33)
at au.gov.wa.dola.eas2.businesszone.businessprocess.message.handler.EmailSummaries_8me4xv_ELOImpl.emailAgentSummaries(Unknown Source)
at au.gov.wa.dola.eas2.scheduler.tasks.EmailAgentSummariesTaskRunner.execute(EmailAgentSummariesTaskRunner.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:283)
at org.springframework.scheduling.quartz.MethodInvokingJobDetailFactoryBean$MethodInvokingJob.executeInternal(MethodInvokingJobDetailFactoryBean.java:272)
at org.springframework.scheduling.quartz.QuartzJobBean.execute(QuartzJobBean.java:86)
at org.quartz.core.JobRunShell.run(JobRunShell.java:203)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:520)
2019-12-16 21:01:32.439 ERROR [faultQuartzScheduler_Worker-0] au.gov.wa.dola.eas2.businesszone.businessprocess.request.EasRequestProcessBean : [java.sql.SQLException: Statement cancelled, probably by transaction timing out]

Re: JBO-27122 errors when using AppDynamics

Allan_Schiebold — Tue, 17 Mar 2020 17:44:38 GMT

Hi. There have been many enhancements around compatibility in agent versions since 4.5.8. Please update to the latest java agent from download.appdynamics.com. Let us know how that works out. Thanks!

Re: JBO-27122 errors when using AppDynamics

Diego_Garibotti — Mon, 23 Mar 2020 03:31:11 GMT

Hi,

I have updated to java agent 4.5.19.29609 in test environment.

I will keep monitoring it to check if this will solve the JBO-27122 issue.

Thanks

Re: JBO-27122 errors when using AppDynamics

Diego_Garibotti — Wed, 01 Apr 2020 00:05:35 GMT

Hi Allan,

After updating to the last agent version, it still showing the JBO-27122 errors.

This errors just started after we update the weblogic.

Any thoughts on what else we can do to fix this issue?

Thanks

Re: JBO-27122 errors when using AppDynamics

Allan_Schiebold — Wed, 01 Apr 2020 23:59:40 GMT

Thanks for the update. I noticed in the docs that it says:

If you have enabled Java 2 security on your WebLogic server, you need to add the following code block to the weblogic.policy file:

grant codeBase "file:/<agent_home>/-"
{ permission java.security.AllPermission; };

If you don't already have that change made in the policy file, I'm wondering if the update on weblogic enabled Java 2 Security. Can you let us know if you're using Java 2 Security? If so, make sure the policy file has been changed with the above config.

Thanks!

Re: JBO-27122 errors when using AppDynamics

Diego_Garibotti — Tue, 21 Apr 2020 23:50:17 GMT

Hi Allan,

Thanks for your reply.

I have just add the code block to the weblogic.policy file.

I will keep monitoring the server for a week or so and I will let you know if this config change

will sort this issue out.

Thanks,

Diego

Re: JBO-27122 errors when using AppDynamics

Diego_Garibotti — Fri, 01 May 2020 00:11:32 GMT

Hi Allan,

After the changes in the weblogic.policy file the error persists.

Any other ideas?

Thanks,

Diego

Re: JBO-27122 errors when using AppDynamics

iamryan — Tue, 05 May 2020 20:13:54 GMT

Hi Diego,

At this point, we recommend opening a support ticket here. https://www.appdynamics.com/support

topic Re: JBO-27122 errors when using AppDynamics in Splunk AppDynamics

JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics

Re: JBO-27122 errors when using AppDynamics