Thank you!!! saved my time 🙂 ... View more

thanks for both ...I realized that the param is for Advanced XML and option is for simple xml as @niketnilay mentioned. Accordingly i have changed and works fine,,@niketnilay...not sure how to accept your answer.kindly let me know ... View more

Hi cusello...with the below regex I can be able to get the whole error. would like to extract date as well from the provided sample. Also is it a good practice to split the event and can show the portion of the error as a description or would you suggest the description also has to extract using REGEX? (?ms)ERROR\s(?<ERROR>.*?)\s+Caused\sby:\s+(?<Caused_by>.*) ... View more

@Ifedak, apologies...initially tried to post this in the comments and somehow could not be able to submit hence added like this...going forward will follow the best practices to post the question and related comments. ... View more

@sbbadri...I have already done that ...still the error exist and then I posted the screenshot ... View more

@cusello...thanks for quick turnaround . with provided regex this is extracting the error. but more precisely looking for the below fields.any suggestion would be appreciated. tried with split and mvindex to get the cause by and succeeded and I am not sure weather that is a right approach. 1. timestamp 2. Error (example: [ibus] [main] ERROR testapp.connectivity.core.cdi.camel.CdiCamelContext: Error starting CamelContext(ibus)) 3. Description: (example: Failed to create route xmlToMxmlRouteStart: Route(xmlToMxmlRouteStart)[[From[jms-tibco:queue:{{jms.inp... because of Failed to resolve endpoint: jms-tibco://queue:testQueue?concurrentConsumers=%5B%25+JMS.TBUS.JMS_Input_Consumers+%25%5D&transacted=true&transactionManager=%) 4. Caused By count 5. Caused by Description(cause1,cause2,cause3,etc) Sample data: 2017-09-06 11:12:38,415 [ibus] [main] ERROR testapp.connectivity.core.cdi.camel.CdiCamelContext: Error starting CamelContext(ibus) org.apache.camel.RuntimeCamelException: org.apache.camel.FailedToCreateRouteException: Failed to create route xmlToMxmlRouteStart: Route(xmlToMxmlRouteStart)[[From[jms-tibco:queue:{{jms.inp... because of Failed to resolve endpoint: jms-tibco://queue:testQueue?concurrentConsumers=%5B%25+JMS.TBUS.JMS_Input_Consumers+%25%5D&transacted=true&transactionManager=%23jtaTransactionManager&useMessageIDAsCorrelationID=true due to: Error during type conversion from type: java.lang.String to the required type: int with value [% JMS.TBUS.JMS_Input_Consumers %] due java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at org.apache.camel.util.ObjectHelper.wrapRuntimeCamelException(ObjectHelper.java:1642) at testapp.connectivity.core.cdi.camel.CdiCamelContext.start(CdiCamelContext.java:101) at testapp.connectivity.core.cdi.camel.CdiCamelContext.startCamelContext(CdiCamelContext.java:77) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:88) at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:78) at org.jboss.weld.injection.MethodInvocationStrategy$DefaultMethodInvocationStrategy.invoke(MethodInvocationStrategy.java:109) at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:306) at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:284) at org.jboss.weld.event.ObserverMethodImpl.notify(ObserverMethodImpl.java:262) at org.jboss.weld.event.ObserverNotifier.notifySyncObservers(ObserverNotifier.java:271) at org.jboss.weld.event.ObserverNotifier.notify(ObserverNotifier.java:260) at org.jboss.weld.event.EventImpl.fire(EventImpl.java:89) at testapp.connectivity.container.core.ManagedService.doStart(ManagedService.java:315) at testapp.connectivity.container.common.lifecycle.LifecycleSupport.start(LifecycleSupport.java:51) at testapp.connectivity.runtime.mx.server.MxServiceServer_3_1_38.doStart(MxServiceServer_3_1_38.java:109) at testapp.connectivity.container.common.lifecycle.LifecycleSupport.start(LifecycleSupport.java:51) at testapp.connectivity.runtime.registry.XmlServerRegistry_3_1_38.registerService(XmlServerRegistry_3_1_38.java:110) at testapp.connectivity.runtime.registry.JmxRegistry.register(JmxRegistry.java:84) at testapp.connectivity.runtime.registry.FileServerRegistry_3_1_0.register(FileServerRegistry_3_1_0.java:20) at testapp.connectivity.container.core.ManagedService. (ManagedService.java:224) at testapp.connectivity.container.core.ManagedService. (ManagedService.java:152) at testapp.connectivity.container.core.ManagedServiceContainer.startService(ManagedServiceContainer.java:158) at testapp.connectivity.container.core.ManagedServiceContainer.startManagedInterface(ManagedServiceContainer.java:301) at testapp.connectivity.container.core.ManagedServiceContainer.startCommand(ManagedServiceContainer.java:295) at testapp.connectivity.container.core.ManagedServiceContainer.executeCommand(ManagedServiceContainer.java:198) at testapp.connectivity.runner.Runner.executeCommand(Runner.java:137) at testapp.connectivity.runner.MxRunner.executeCommand(MxRunner.java:36) at testapp.connectivity.runner.Runner.bootstrapRunner(Runner.java:249) at testapp.connectivity.runner.Runner.bootstrapRunner(Runner.java:103) at testapp.connectivity.runner.MxRunner.bootstrapRunner(MxRunner.java:59) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at testapp.connectivity.client.ConnectivityRunnerBoot.startRunner(ConnectivityRunnerBoot.java:801) at testapp.connectivity.client.ConnectivityRunnerBoot.startInterface(ConnectivityRunnerBoot.java:753) at testapp.connectivity.client.ConnectivityRunnerBoot. (ConnectivityRunnerBoot.java:141) at testapp.connectivity.client.ConnectivityRunnerBoot.main(ConnectivityRunnerBoot.java:277) Caused by: org.apache.camel.FailedToCreateRouteException: Failed to create route xmlToMxmlRouteStart: Route(xmlToMxmlRouteStart)[[From[jms-tibco:queue:{{jms.inp... because of Failed to resolve endpoint: jms-tibco://queue:testQueue?concurrentConsumers=%5B%25+JMS.TBUS.JMS_Input_Consumers+%25%5D&transacted=true&transactionManager=%23jtaTransactionManager&useMessageIDAsCorrelationID=true due to: Error during type conversion from type: java.lang.String to the required type: int with value [% JMS.TBUS.JMS_Input_Consumers %] due java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:201) at org.apache.camel.impl.DefaultCamelContext.startRoute(DefaultCamelContext.java:947) at org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:3258) at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:2981) at org.apache.camel.impl.DefaultCamelContext.access$000(DefaultCamelContext.java:175) at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:2812) at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:2808) at org.apache.camel.impl.DefaultCamelContext.doWithDefinedClassLoader(DefaultCamelContext.java:2831) at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:2808) at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61) at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:2777) at testapp.connectivity.core.cdi.camel.CdiCamelContext.start(CdiCamelContext.java:99) ... 40 more Caused by: org.apache.camel.ResolveEndpointFailedException: Failed to resolve endpoint: jms-tibco://queue:testQueue?concurrentConsumers=%5B%25+JMS.TBUS.JMS_Input_Consumers+%25%5D&transacted=true&transactionManager=%23jtaTransactionManager&useMessageIDAsCorrelationID=true due to: Error during type conversion from type: java.lang.String to the required type: int with value [% JMS.TBUS.JMS_Input_Consumers %] due java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at org.apache.camel.impl.DefaultCamelContext.getEndpoint(DefaultCamelContext.java:590) at org.apache.camel.util.CamelContextHelper.getMandatoryEndpoint(CamelContextHelper.java:79) at org.apache.camel.model.RouteDefinition.resolveEndpoint(RouteDefinition.java:211) at org.apache.camel.impl.DefaultRouteContext.resolveEndpoint(DefaultRouteContext.java:107) at org.apache.camel.impl.DefaultRouteContext.resolveEndpoint(DefaultRouteContext.java:113) at org.apache.camel.model.FromDefinition.resolveEndpoint(FromDefinition.java:69) at org.apache.camel.impl.DefaultRouteContext.getEndpoint(DefaultRouteContext.java:89) at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:1052) at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:196) ... 51 more Caused by: org.apache.camel.TypeConversionException: Error during type conversion from type: java.lang.String to the required type: int with value [% JMS.TBUS.JMS_Input_Consumers %] due java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at org.apache.camel.impl.converter.BaseTypeConverterRegistry.createTypeConversionException(BaseTypeConverterRegistry.java:610) at org.apache.camel.impl.converter.BaseTypeConverterRegistry.mandatoryConvertTo(BaseTypeConverterRegistry.java:177) at org.apache.camel.impl.converter.BaseTypeConverterRegistry.mandatoryConvertTo(BaseTypeConverterRegistry.java:156) at org.apache.camel.util.IntrospectionSupport.convert(IntrospectionSupport.java:622) at org.apache.camel.util.IntrospectionSupport.setProperty(IntrospectionSupport.java:537) at org.apache.camel.util.IntrospectionSupport.setProperty(IntrospectionSupport.java:602) at org.apache.camel.util.IntrospectionSupport.setProperties(IntrospectionSupport.java:459) at org.apache.camel.util.IntrospectionSupport.setProperties(IntrospectionSupport.java:469) at org.apache.camel.util.EndpointHelper.setProperties(EndpointHelper.java:256) at org.apache.camel.impl.DefaultComponent.setProperties(DefaultComponent.java:257) at org.apache.camel.component.jms.JmsComponent.createEndpoint(JmsComponent.java:886) at org.apache.camel.impl.DefaultComponent.createEndpoint(DefaultComponent.java:114) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jboss.weld.bean.proxy.AbstractBeanInstance.invoke(AbstractBeanInstance.java:38) at org.jboss.weld.bean.proxy.ProxyMethodHandler.invoke(ProxyMethodHandler.java:100) at org.jboss.weld.proxies.CamelContextAware$Component$1063300809$Proxy$_$$_WeldClientProxy.createEndpoint(Unknown Source) at org.apache.camel.impl.DefaultCamelContext.getEndpoint(DefaultCamelContext.java:570) ... 59 more Caused by: org.apache.camel.RuntimeCamelException: java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at org.apache.camel.util.ObjectHelper.wrapRuntimeCamelException(ObjectHelper.java:1642) at org.apache.camel.util.ObjectHelper.invokeMethod(ObjectHelper.java:1247) at org.apache.camel.impl.converter.StaticMethodTypeConverter.convertTo(StaticMethodTypeConverter.java:59) at org.apache.camel.impl.converter.BaseTypeConverterRegistry.doConvertTo(BaseTypeConverterRegistry.java:315) at org.apache.camel.impl.converter.BaseTypeConverterRegistry.mandatoryConvertTo(BaseTypeConverterRegistry.java:168) ... 77 more Caused by: java.lang.NumberFormatException: For input string: "[% JMS.TBUS.JMS_Input_Consumers %]" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:580) at java.lang.Integer.valueOf(Integer.java:766) at org.apache.camel.converter.ObjectConverter.toInteger(ObjectConverter.java:262) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.camel.util.ObjectHelper.invokeMethod(ObjectHelper.java:1243) ... 80 more ... View more

@Sukisen1981: The moment I say | rex field=_raw (? .*?)": Error" the search will hung since too many errors will be there in the log and leads to performance hit. Is there way we can extract a portion and then try? Error and related causeby from the logs ... View more

@Ifedak: its my pleasure to accept for such a kind of help from the community.Infact was discussing the answer further that's where I was waiting to accept.now accepted and thanks for reminder 🙂 ... View more

@niketn: This works fine. Quick question on the event split. below is the data it flows to splunk as one file.somehow splunk is splitting the whole file as one event. Is this below sample data supposed to split as 6 events?please clarify Java HotSpot(TM) 64-Bit Server VM (25.141-b15) for linux-amd64 JRE (1.8.0_141-b15), built on Sep 11 2017 03:25:22 by "java_re" with gcc 4.3.0 20080428 Memory: 4k page, physical 132155544k(50054816k free), swap 33553404k(33517360k free) 4.493: [Full GC (System.gc()) 671129K->61731K(32156672K), 0.1042161 secs] 4.597: [Full GC (System.gc()) 61731K->60858K(32156672K), 0.2231717 secs] 11567.840: [Full GC (Allocation Failure) 85994K->27730K(247808K), 0.0030062 secs] 11947.795: [Full GC (System.gc()) 41757K->27562K(248320K), 0.0035917 secs] 11947.797: [Full GC (System.gc()) 27562K->22923K(248320K), 0.1237187 secs] ... View more

attachment for the post ... View more

@Sukisen1981: my requirement is simple. just need a trend line out of the below data. also posting my statisticstab and visualizationtab images totaltime: 28820.220 8347.678 11947.797 duration: 0.0261704 0.1147433 0.1237187 how will you populate the totaltime on x-axis and duration on y-axis? | stats values(totaltime) as totdur values(Duration) as duration ... View more

@Sukisen1981...thank you for your response .will check and comeback ASAP ... View more

@Sukisen1981 thanks again and no results and chart are displaying when i followed. any otherway to populate only values not the statistics as mentioned in the below rex rex max_match=0 field=_raw "(?m)^(?<timestamp>[^:]+):\s+\[(?<FullGCEvents>Full.*)\s+(?<field1>\d+)K-\>(?<field2>\d+)K\((?<field3>\d+)K\),\s+(?<gctime>[^\s]+)\ssecs\]" | chart max(gctime) as Duration by timestamp ... View more

@niketnilay Below are the clarifications 1. by using the REGEX that you have specified .am trying to extract totaltime and duration 2. serv is the part of source and I am extracting it from source by using split 3. need to get latest values of totaltime and duration by every source and show this as a trend. advise if any? below is the regex and chart using and expected results are not getting. Needs to populate the values of totaltime and duration for each serv(source) rex max_match=0 field=_raw "(?m)^(?<timestamp>[^:]+):\s+\[(?<FullGCEvents>Full.*)\s+(?<field1>\d+)K-\>(?<field2>\d+)K\((?<field3>\d+)K\),\s+(?<gctime>[^\s]+)\ssecs\]" | chart max(gctime) as Duration by timestamp ... View more

unfortunately blocked from my work place ... View more

@inventsekar Here is the image values when I run the below query...but the goal is on x-axis needs to show the timestamp and y-axis the duration with line graph when hover both the timestamp and duration has to show as per the below image. Now this is showing the max values...but has to show all the values rex max_match=0 field=_raw "(?m)^(?<timestamp>[^:]+):\s+\[(?<FullGCEvents>Full.*)\s+(?<field1>\d+)K-\>(?<field2>\d+)K\((?<field3>\d+)K\),\s+(?<gctime>[^\s]+)\ssecs\]" | chart max(gctime) as Duration by timestamp ... View more

I am not getting the chart only in the x-axis the values of timestamp are populating. my requirement is I no need to convert the time as I have to display the as is of timestamp and gctime...somehow could not be able to attach image ![alt text][1] ... View more

@inventsekar: Thanks for the regex...it works fine. would like to show a trend chart for the Full GC events with values of timestamp in x-axis and gctime at y-axis..kind of line chart...I know some stats functions we have to use here but how to populate the actual values of timestamp and gctime and show the graph | rex max_match=0 field=_raw "(?m)^(?<timestamp>[^:]+):\s+\[(?<FullGCEvents>Full.*)\s+(?<field1>\d+)K-\>(?<field2>\d+)K\((?<field3>\d+)K\),\s+(?<gctime>[^\s]+)\ssecs\]" |where like(serv1,"%serv1%") | chart values(gctime) as gctime by timestamp timestamp: 28820.220 8347.678 11947.797 gctime: 0.0261704 0.1147433 0.1237187 serv name from the filename which is source serv1 ... View more

@Sukisen1981...below is the data the chart or timechart supposed to populate from the sampledata provided in the post totaltime: 28820.220 8347.678 11947.797 duration: 0.0261704 0.1147433 0.1237187 serv name from the filename which is source serv1 ... View more

@Sukisen: thanks for reply.please read the post about my requirement and let me know any suggestions.would like to populate the totaltime values on x-axis and duration on y-axis by serv name where serv name comes from the file name which includes in the source. ... View more