rex is not extracting for longer events

DataOrg — Tue, 01 Jun 2021 04:51:46 GMT

I have extracting data for a longer events the regex fails with below error. please help with efficient expression

I had tried increasing the depth_limit still its throwing error.

Re: rex is not extracting for longer events

aasabatini — Fri, 28 May 2021 06:40:15 GMT

Hi @DataOrg

if you can share the event I could help you better

Regards

Alessandro

Re: rex is not extracting for longer events

DataOrg — Fri, 28 May 2021 07:52:32 GMT

@aasabatini

Pls view the event on the link

https://regex101.com/r/FpHTTg/1

Re: rex is not extracting for longer events

kamlesh_vaghela — Fri, 28 May 2021 08:47:15 GMT

@DataOrg

You have to reduce steps in regex.

Update your regular expression and try again.

By updating the rex I'm able to get results.

\s\-\s(?P<Log_Message>.*)$

This is sample rex. Update it as per your requirement.

Thanks
KV
▄︻̷̿┻̿═━一

If any of my reply helps you to solve the problem Or gain knowledge, an upvote would be appreciated.

Re: rex is not extracting for longer events

DataOrg — Tue, 01 Jun 2021 04:53:20 GMT

@kamlesh_vaghela

If whitespace is available the extraction stops at some place. pls refer this

Re: rex is not extracting for longer events

kamlesh_vaghela — Fri, 28 May 2021 15:13:32 GMT

@DataOrg

Is it ok if we get required value in raw?

Can you please try this?

YOUR_SEARCH | rex field=_raw mode=sed "s/^(?P<AA>\[.*?\]\[.*?\]\s\-\s)//g"

My Sample Search :

| makeresults | eval _raw="[ERROR][D1633275A3C5A9D40777C4757ED78440][ajp-nio-127.0.0.1-8159-exec-2][28/05/2021 06:34:18] o.g.w.e.GrailsExceptionResolver [dsbptesting.im][] - BatchUpdateException occurred when processing request: [POST] /basePlan/productPipo/batchUpdate ORA-00060: deadlock detected while waiting for resource . Stacktrace follows: com.pg.dsbp.base.ApplicationException: Batch operation causes error with following details:;Affected class: class com.pg.basePlan.ProductPipoPlant;Affected records: com.pg.basePlan.ProductPipoPlant(id:610221, initiativeId:57355, prodPipoId:225282, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, prodPipoId:225282, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610223, initiativeId:57355, prodPipoId:225286, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, prodPipoId:225286, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610222, initiativeId:57355, prodPipoId:225264, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, prodPipoId:225264, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610224, initiativeId:57355, prodPipoId:225265, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, prodPipoId:225265, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610225, initiativeId:57355, prodPipoId:225283, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, prodPipoId:225283, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610219, initiativeId:57355, prodPipoId:225284, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, prodPipoId:225284, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610226, initiativeId:57355, prodPipoId:225285, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, prodPipoId:225285, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610220, initiativeId:57355, prodPipoId:225287, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, prodPipoId:225287, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);com.pg.basePlan.ProductPipoPlant(id:610227, initiativeId:57355, prodPipoId:225266, plantId:21214, plantPhaseType:PI_PRODUCING, sopDate:null, excluded:true, sequenceName:BP_PROD_PIPO_PLANT_SEQ, properties:[initiativeId:57355, createdAt:2021-05-28 06:33:48.0, lastModifiedBy:dsbptesting.im, createdBy:dsbptesting.im, sequenceName:BP_PROD_PIPO_PLANT_SEQ, plantId:21214, prodPipoId:225266, plantPhaseType:PI_PRODUCING, sopDate:null, plantPhaseTypeId:null, excluded:true, lastModifiedAt:2021-05-28 06:34:14.14], dirty:false, plantPhaseTypeId:null, dirtyPropertyNames:[], attached:false, errors:org.grails.datastore.mapping.validation.ValidationErrors: 0 errors);java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62);java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45);com.pg.basePlan.SimpleBatchOperationsService.$tt__batchUpdate(SimpleBatchOperationsService.groovy:88);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);grails.gorm.transactions.GrailsTransactionTemplate$2.doInTransaction(GrailsTransactionTemplate.groovy:94);org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140);grails.gorm.transactions.GrailsTransactionTemplate.execute(GrailsTransactionTemplate.groovy:91);com.pg.basePlan.SimpleBatchOperationsService.batchUpdate(SimpleBatchOperationsService.groovy:62);com.pg.basePlan.productpipo.ProductPipoPlants$1.accept(ProductPipoPlants.groovy:325);com.pg.basePlan.productpipo.ProductPipoPlants.updateProductPipoPlantsWithSaving(ProductPipoPlants.groovy:170);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.productpipo.ProductPipoPlants.updateProductPipoPlantsWithSavingWithOldCheck(ProductPipoPlants.groovy:103);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.productpipo.PipoPhasesPlantService.forUpdated(PipoPhasesPlantService.groovy:58);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.productpipo.ProductPipoBatchSave.update(ProductPipoBatchSave.groovy:178);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.productpipo.ProductPipoBatchSave.apply(ProductPipoBatchSave.groovy:121);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.productpipo.ProductPipoService.$tt__doBatchSave(ProductPipoService.groovy:173);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);grails.gorm.transactions.GrailsTransactionTemplate$2.doInTransaction(GrailsTransactionTemplate.groovy:94);org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140);grails.gorm.transactions.GrailsTransactionTemplate.execute(GrailsTransactionTemplate.groovy:91);com.pg.basePlan.productpipo.ProductPipoService.$tt__batchSave(ProductPipoService.groovy:159);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);grails.gorm.transactions.GrailsTransactionTemplate$2.doInTransaction(GrailsTransactionTemplate.groovy:94);org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140);grails.gorm.transactions.GrailsTransactionTemplate.execute(GrailsTransactionTemplate.groovy:91);com.pg.basePlan.ProductPipoController.batchSaveRecords(ProductPipoController.groovy:174);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.ProductPipoController$_batchUpdate_closure2.doCall(ProductPipoController.groovy:155);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.BatchServiceOperationsLogger.executeBatch(BatchServiceOperationsLogger.groovy:36);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.BatchServiceOperationsLogger.update(BatchServiceOperationsLogger.groovy:18);com.pg.basePlan.BaseController.wrapUpdate(BaseController.groovy:315);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);com.pg.basePlan.ProductPipoController.batchUpdate(ProductPipoController.groovy:154);org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218);org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:750);org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163);org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88);com.pg.basePlan.interceptors.RequestInterceptor.controllerAction(RequestInterceptor.groovy:24);java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43);org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644);org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633);org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70);org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186);org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:93);org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186);org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:689);org.grails.core.DefaultGrailsControllerClass$MethodHandleInvoker.invoke(DefaultGrailsControllerClass.java:223);org.grails.core.DefaultGrailsControllerClass.invoke(DefaultGrailsControllerClass.java:188);org.grails.web.mapping.mvc.UrlMappingsInfoHandlerAdapter.handle(UrlMappingsInfoHandlerAdapter.groovy:90);org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040);org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943);org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006);org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909);org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:320);org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127);org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:119);grails.plugin.springsecurity.web.UpdateRequestContextHolderExceptionTranslationFilter.doFilter(UpdateRequestContextHolderExceptionTranslationFilter.groovy:64);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);grails.plugin.springsecurity.web.filter.GrailsHttpPutFormContentFilter.doFilterInternal(GrailsHttpPutFormContentFilter.groovy:54);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);grails.plugin.springsecurity.web.filter.GrailsAnonymousAuthenticationFilter.doFilter(GrailsAnonymousAuthenticationFilter.groovy:54);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:158);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);grails.plugin.springsecurity.web.authentication.logout.MutableLogoutFilter.doFilter(MutableLogoutFilter.groovy:64);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.saml.SAMLLogoutProcessingFilter.processLogout(SAMLLogoutProcessingFilter.java:209);org.springframework.security.saml.SAMLLogoutProcessingFilter.doFilter(SAMLLogoutProcessingFilter.java:107);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.saml.SAMLLogoutFilter.processLogout(SAMLLogoutFilter.java:168);org.springframework.security.saml.SAMLLogoutFilter.doFilter(SAMLLogoutFilter.java:110);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.saml.metadata.MetadataDisplayFilter.doFilter(MetadataDisplayFilter.java:84);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.saml.SAMLEntryPoint.doFilter(SAMLEntryPoint.java:102);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);grails.plugin.springsecurity.web.SecurityRequestHolderFilter.doFilter(SecurityRequestHolderFilter.groovy:58);org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334);org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215);org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178);org.grails.web.servlet.mvc.GrailsWebRequestFilter.doFilterInternal(GrailsWebRequestFilter.java:77);org.grails.web.filters.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:67);org.springframework.boot.web.servlet.support.ErrorPageFilter.doFilter(ErrorPageFilter.java:128);org.springframework.boot.web.servlet.support.ErrorPageFilter.access$000(ErrorPageFilter.java:66);org.springframework.boot.web.servlet.support.ErrorPageFilter$1.doFilterInternal(ErrorPageFilter.java:103);org.springframework.boot.web.servlet.support.ErrorPageFilter.doFilter(ErrorPageFilter.java:121);psiprobe.Tomcat90AgentValve.invoke(Tomcat90AgentValve.java:35);java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128);java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628);java.base/java.lang.Thread.run(Thread.java:834);Caused by: java.sql.BatchUpdateException: ORA-00060: deadlock detected while waiting for resource;;oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:10401);oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:230);groovy.sql.BatchingStatementWrapper.executeBatch(BatchingStatementWrapper.java:87);groovy.sql.Sql.withBatch(Sql.java:3825);com.pg.basePlan.SimpleBatchOperationsService.$tt__batchUpdate(SimpleBatchOperationsService.groovy:76);... 107 common frames omitted;" | rex field=_raw mode=sed "s/^(?P<AA>\[.*?\]\[.*?\]\s\-\s)//g"

Thanks
KV
▄︻̷̿┻̿═━一

If any of my reply helps you to solve the problem Or gain knowledge, an upvote would be appreciated.

topic Re: rex is not extracting for longer events in All Apps and Add-ons

rex is not extracting for longer events

Re: rex is not extracting for longer events

Re: rex is not extracting for longer events

Re: rex is not extracting for longer events

Re: rex is not extracting for longer events

Re: rex is not extracting for longer events