All Topics

Find Answers
Ask questions. Get answers. Find technical product solutions from passionate members of the Splunk community.

All Topics

Hi, I am trying to run a python script on my universal forwarder which send data to splunk cloud instance. I have added the path in inputs.conf and there is not events found in my index. While ch... See more...
Hi, I am trying to run a python script on my universal forwarder which send data to splunk cloud instance. I have added the path in inputs.conf and there is not events found in my index. While checking on splunkd logs, there shows a error "The system cannot find the file specified". what could be the problem?
I want to create a Bar chart with the logs where the key would be the stats count field name and value would be the sum value Query :  search1 | eval has_error = if(match(_raw, "WARNING"),1,0)| s... See more...
I want to create a Bar chart with the logs where the key would be the stats count field name and value would be the sum value Query :  search1 | eval has_error = if(match(_raw, "WARNING"),1,0)| stats sum(has_error) as field1| join instance [search2 | eval has_error = if(match(_raw, "WARNING"),1,0)| stats sum(has_error) as field2| join instance [search3 | eval has_error = if(match(_raw, "WARNING"),1,0)| stats sum(has_error) as field3|join instance [search4  | eval has_error = if(match(_raw, "WARNING"),1,0)| stats sum(has_error) as field4]]] | stats sum( field1), sum(field2), sum( field3), sum( field4) Current result: field1 field2 field3 field4 30 44 122 6   Expected result: Field Count field1 30 field2 44 field3 122 field4 6
Can I convert a playbook-type input to automation in Splunk SOAR (5.3.4) Thanks for helping.
i All   There are query splunk like this :  (index=Prod sourcetype=ProdApp (host=Prod01 OR Prod02) source="/prodlib/SPLID" "Response" ERR-12120) | rex "^(?:[^\[\n]*\[){6}(?P<u>\w+)" | rex... See more...
i All   There are query splunk like this :  (index=Prod sourcetype=ProdApp (host=Prod01 OR Prod02) source="/prodlib/SPLID" "Response" ERR-12120) | rex "^(?:[^\[\n]*\[){6}(?P<u>\w+)" | rex field=_raw "(?<my_json>\{.*)" | spath input=my_json output=customerName path=response.login.customerName | spath input=my_json output=responseCode path=response.responseHeader.responseContext.responseCode | dedup customerName | table customerName,responseCode | append [search index=Prod sourcetype=ProdApp (host=Prod01 OR Prod02) source="/prodlib/SPLID" "Request") | rex "^(?:[^\[\n]*\[){6}(?P<u>\w+)" | rex field=_raw "(?<my_json>\{.*)" | spath input=my_json output=userId path=data.userId | dedup userId | table userId] I will try to join both source from Request and Response, and result like below attachment : My question  is, how show for 5 user id's ? (in blue line) Because i already try join both sources, the user id shown not related for the customer name (in black line) Picture
Hi team, we have performance log in splunk, but the storage policy is only for 3 month. so i can't see data metric trend from splunk for whole 1 year. Is there anyway splunk can ingest data into ... See more...
Hi team, we have performance log in splunk, but the storage policy is only for 3 month. so i can't see data metric trend from splunk for whole 1 year. Is there anyway splunk can ingest data into MongoDB? so that I can use powerBI to connect to MongoDB, and do analysis in PowerBI. Thanks, Cherie
 
For the type of data I am trying to extract, Event Sampling really speeds up the query. This works fine when executing SPL queries, but I have not been able to figure out how to do this in a dashboar... See more...
For the type of data I am trying to extract, Event Sampling really speeds up the query. This works fine when executing SPL queries, but I have not been able to figure out how to do this in a dashboard. Found some older posts where "rand" was used, but apparently that did not speed up the query.   Is it possible to specify Event Sampling directly in a Search Query or in the Dashboard in some way?
Hi, I have multiple panels that need to run timecharts like these: something | table _time,A,B</query> | search A="1"| timechart B something | table _time,A,B</query> | search A="2"| timechar... See more...
Hi, I have multiple panels that need to run timecharts like these: something | table _time,A,B</query> | search A="1"| timechart B something | table _time,A,B</query> | search A="2"| timechart B something | table _time,A,B</query> | search A="3"| timechart B I want to optimize my dashboard for performance by using a base search, so I tried this: <search id="base> <query> something | table _time,A,B</query> </search> .... <panel> <chart> <search base="base"> <query>search A="1"|timechart count by B</query> </search> </chart> </panel> ... <panel> <chart>   <search base="base"> <query>search A="2"|timechart count by B</query> </search> </chart> </panel> ... <panel> <chart> <search base="base"> <query>search A="3"|timechart count by B</query> </search> </chart> </panel> It works great on short times (24h) but with wider ranges (30 days) I lose events because of the base search limit (probably the default, 500,000). Is there a way I can use base search for this? I'm using Splunk Enterprise version 8.1.3.  
I am using the query as below and visualizing it in a line chart.  There is date field coming on the line chart and I want to remove it through XML without removing time field? Can someone guide me... See more...
I am using the query as below and visualizing it in a line chart.  There is date field coming on the line chart and I want to remove it through XML without removing time field? Can someone guide me .  (I was able to remove it in query using field format command but it was not super helpful as I was not able to see visualization.)  Also, I was able to remove the hover through this article - Solved: How to disable mouse hover on bar chart in XML - Splunk Community But not the date.  This one is very close to what I want to do, but didn't solve my case on the line chart.  Solved: How to delete the date category on a visualization... - Splunk Community Query for reference index=xyz sourctype=abc earliest = -60m@m latest = @m |eval ReportKey="Today" |append [search index=index=xyz sourctype=abc earliest = -60m@m-1w latest = @m-1w |eval ReportKey="LastWeek" | eval _time=relative_time(_time, "+1w")] |append [search index=index=xyz sourctype=abc earliest = -60m@m-2w latest = @m-2w |eval ReportKey="TwoWeeksBefore" | eval _time=relative_time(_time, "+2w")] |append [search index=index=xyz sourctype=abc earliest = -60m@m-3w latest = @m-3w |eval ReportKey="ThreeWeeksBefore" | eval _time=relative_time(_time, "+3w")] |timechart span = 1m count(index) as Volume by Reportkey  
For example, the "SUBMIT_DATE" is split by date and time. Then define some period of time as a value(A/B/C). Can this be achieved? (SUBMIT_DATE="2021-03-09 14:30:48.0")  ==> Split to "2021-03-09" a... See more...
For example, the "SUBMIT_DATE" is split by date and time. Then define some period of time as a value(A/B/C). Can this be achieved? (SUBMIT_DATE="2021-03-09 14:30:48.0")  ==> Split to "2021-03-09" and "14:30:48.0" 0:00:00 - 8:00:00 = A 8:00:00 - 16:00:00 = B 16:00:00 - 0:00:00 = C        
Hi Team, I have  several Dashboards that contain base searches data from reports  for example:  <search id="baseSearch" ref="Report"></search>  but, I see that I am not getting option to add... See more...
Hi Team, I have  several Dashboards that contain base searches data from reports  for example:  <search id="baseSearch" ref="Report"></search>  but, I see that I am not getting option to add time token on dashboard. Is there any option we can provide the time token to expand or reduced time window for end users on dashboard by using ref="Report" saved search method ? 
Hey all, I am trying to extract dynamic field from json . {"period":{"start":"2023-04-17","end":"2023-05-14"},"check-ins":{"203":{"avail":5,"price":5},"204":{"avail":5,"price":5},"205":{"avail":5... See more...
Hey all, I am trying to extract dynamic field from json . {"period":{"start":"2023-04-17","end":"2023-05-14"},"check-ins":{"203":{"avail":5,"price":5},"204":{"avail":5,"price":5},"205":{"avail":5,"price":5},"206":{"avail":5,"price":5},"207":{"avail":5,"price":5},"208":{"avail":5,"price":5},"209":{"avail":5,"price":5},"210":{"avail":5,"price":5},"211":{"avail":5,"price":5},"212":{"avail":5,"price":5},"213":{"avail":5,"price":5},"214":{"avail":5,"price":5},"215":{"avail":5,"price":5},"216":{"avail":5,"price":5},"217":{"avail":5,"price":5},"218":{"avail":5,"price":5},"219":{"avail":19,"price":5},"220":{"avail":19,"price":5},"221":{"avail":19,"price":5},"222":{"avail":19,"price":5},"223":{"avail":19,"price":5},"224":{"avail":19,"price":5},"225":{"avail":19,"price":5},"226":{"avail":19,"price":5},"227":{"avail":19,"price":5},"228":{"avail":19,"price":5},"229":{"avail":20,"price":5},"230":{"avail":20,"price":5}}}   I need to extract 203,204,205.........till 230 as per data mentioned above then each extracted value will be added in period.start field . At the end I need that date value after addition   Thanks in advance
When I looked into splunkd log, found the below error message     UserWarning: The soupsieve package is not installed. CSS selectors cannot be used       Can someone please assist with ... See more...
When I looked into splunkd log, found the below error message     UserWarning: The soupsieve package is not installed. CSS selectors cannot be used       Can someone please assist with this ?
I recently upgraded our splunk enterprise to version9.0.1 but I do have problems with the kvstore. Any ideas on how to deal with this please?
I'm trying to use the Splunk 9 addition in foreach iteration with ITEM, but it always returns "Failed to parse templatized search for field 'i'" on my server, which runs 9.0.1.       | makere... See more...
I'm trying to use the Splunk 9 addition in foreach iteration with ITEM, but it always returns "Failed to parse templatized search for field 'i'" on my server, which runs 9.0.1.       | makeresults | eval i = mvrange(0,3) | foreach i [eval showme = <<ITEM>>]        I previously used <<ITEM>> on a laptop Splunk 9 and it didn't have this error.
I would like to create a PIE chart only using the percentage for the ID's who are all completed how many number of certificates .    For example ,  ID            No of Courses_completed  0112... See more...
I would like to create a PIE chart only using the percentage for the ID's who are all completed how many number of certificates .    For example ,  ID            No of Courses_completed  0112         3 0113          1 0114          2 0115           3 0116           0  Likewise I have 1000's of ID . Here I need to find out from total ID , 30% of them completed 2 courses , 40% of them completed 3 courses, 15 % of them completed 1 course, 15% of them not attended any course in PIE chart view. Kindly help to acquire this.  
I support a Splunk App for our company and we recently made some changes to the dashboards we ship with the app - most specifically, updating the dashboard version and removing a script that was not ... See more...
I support a Splunk App for our company and we recently made some changes to the dashboards we ship with the app - most specifically, updating the dashboard version and removing a script that was not Python 3 compatible. However, when customers updated the app, because the user of the App made some small changes to the dashboards, these dashboards did not get updated to the latest dashboards and were showing issues with the old script and the dashboard version - since the changed dashboard would be in the local directory vs. default. Is there a way for us as the developers of the app to merge or force specific changes to a dashboard for our app even if there were customizations made to the dashboard by the customer? Perhaps a warning that dashboard X is not being updated because a local version exists? Thanks, Paul
I am running a query |tstats count latest(_time) where index=abcd by host, my requirement is to create an alert when the count is 0, when there would be no event in the index.  My problem is when ... See more...
I am running a query |tstats count latest(_time) where index=abcd by host, my requirement is to create an alert when the count is 0, when there would be no event in the index.  My problem is when there is no event I am not getting the count field as 0.
In ES I am reviewing results from the "Concurrent Login Attempts Detected" correlation search which is as follows:     | datamodel "Identity_Management" High_Critical_Identities search | renam... See more...
In ES I am reviewing results from the "Concurrent Login Attempts Detected" correlation search which is as follows:     | datamodel "Identity_Management" High_Critical_Identities search | rename All_Identities.identity as "user" | fields user | eval cs_key='user' | join type=inner cs_key [| tstats `summariesonly` count from datamodel=Authentication by _time,Authentication.app,Authentication.src,Authentication.user span=1s | `drop_dm_object_name("Authentication")` | eventstats dc(src) as src_count by app,user | search src_count>1 | sort 0 + _time | streamstats current=t window=2 earliest(_time) as previous_time,earliest(src) as previous_src by app,user | where (src!=previous_src) | eval time_diff=abs(_time-previous_time) | where time_diff<300 | eval cs_key='user']     The issue is that I am seeing false positives for users who previous src is say "abc-xyz-01" and current src is "abc-xyz-02", basically systems with similar names (servers in clusters/pairs). Would it be possible to use a regex for the wordlist in the Fuzzy Search for Splunk app and then filter out similar matches with a lower ratio?  
Hi, I am getting the error below when starting my app, and I can´t know what config causes this error. Thanks for helping. cd /opt/app-dynamics/appdynamics/ver22.8.0.34104/logs/payments-v2-gwproxy ... See more...
Hi, I am getting the error below when starting my app, and I can´t know what config causes this error. Thanks for helping. cd /opt/app-dynamics/appdynamics/ver22.8.0.34104/logs/payments-v2-gwproxy head -n 150 agent.2022_09_10__02_14_48.log [AD Agent init] 10 Sep 2022 02:14:48,954 INFO JavaAgent - Logging set up for log4j2 [AD Agent init] 10 Sep 2022 02:14:48,955 INFO JavaAgent - #################################################################################### [AD Agent init] 10 Sep 2022 02:14:48,955 INFO JavaAgent - Java Agent Directory [/opt/app-dynamics/appdynamics/ver22.8.0.34104] [AD Agent init] 10 Sep 2022 02:14:48,955 INFO JavaAgent - Java Agent AppAgent directory [/opt/app-dynamics/appdynamics/ver22.8.0.34104] [AD Agent init] 10 Sep 2022 02:14:48,955 INFO JavaAgent - Using Java Agent Version [Server Agent #22.8.0.34104 v22.8.0 GA compatible with 4.4.1.0 r76b2bb8f45a498afcc5ecaf5a1a9480ed0d4998b release/22.8.0] [AD Agent init] 10 Sep 2022 02:14:48,955 INFO JavaAgent - All agent classes have been pre-loaded [AD Agent init] 10 Sep 2022 02:14:48,965 INFO AgentKernel - Starting Java Agent at Sat Sep 10 02:14:48 BRT 2022 ... [AD Agent init] 10 Sep 2022 02:14:48,968 INFO AgentKernel - Time zone: Brasilia Standard Time [AD Agent init] 10 Sep 2022 02:14:49,069 INFO XMLConfigManager - Orchestration is disabled - disabling virtualization resolvers by default. [AD Agent init] 10 Sep 2022 02:14:49,072 INFO ContainerIdExtractor - Detected unique host name: 1942113ced913b7b16c58fd891ed8c36f1bf5de6487c340d803dadc7c2a26618 [AD Agent init] 10 Sep 2022 02:14:49,154 INFO XMLConfigManager - Default Controller Info Resolver found env variable [APPDYNAMICS_CONTROLLER_HOST_NAME] for controller host name [appdynamics-prd.getnet.com.br] [AD Agent init] 10 Sep 2022 02:14:49,154 INFO XMLConfigManager - Default Controller Info Resolver found env variable [APPDYNAMICS_CONTROLLER_PORT] for controller port [8090] [AD Agent init] 10 Sep 2022 02:14:49,156 INFO XMLConfigManager - Detected Kubernetes environment, attempting to fetch unique host name [AD Agent init] 10 Sep 2022 02:14:49,156 INFO XMLConfigManager - Kubernetes Agent Resolver found env variable [APPDYNAMICS_AGENT_UNIQUE_HOST_ID] for unique host identifier [1942113ced91] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Default IP Address Resolver found IP addresses [[fe80:0:0:0:18eb:e8ff:fef3:4861%eth0, 10.131.16.49]] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Default Agent Account Info Resolver found env variable [APPDYNAMICS_AGENT_ACCOUNT_NAME] for account name [customer1] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Default Agent Account Info Resolver found env variable [APPDYNAMICS_AGENT_ACCOUNT_ACCESS_KEY] for account access key [****] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Full Agent Registration Info Resolver found env variable [APPDYNAMICS_AGENT_APPLICATION_NAME] for application name [PD-Microsservicos] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Full Agent Registration Info Resolver found env variable [APPDYNAMICS_AGENT_TIER_NAME] for tier name [payments-v2-gwproxy] [AD Agent init] 10 Sep 2022 02:14:49,158 INFO XMLConfigManager - Full Agent Registration Info Resolver found env variable [APPDYNAMICS_AGENT_NODE_NAME] for node name [payments-v2-gwproxy] [AD Agent init] 10 Sep 2022 02:14:49,161 INFO XMLConfigManager - Full Agent Registration Info Resolver using selfService [false] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Full Agent Registration Info Resolver using selfService [false] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Full Agent Registration Info Resolver using ephemeral node setting [false] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Full Agent Registration Info Resolver using application name [PD-Microsservicos] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Read property [reuse node name] from environment variable [APPDYNAMICS_JAVA_AGENT_REUSE_NODE_NAME] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Full Agent Registration Info Resolver using tier name [payments-v2-gwproxy] [AD Agent init] 10 Sep 2022 02:14:49,163 INFO XMLConfigManager - Full Agent Registration Info Resolver using node name [payments-v2-gwproxy] [AD Agent init] 10 Sep 2022 02:14:49,166 WARN XMLConfigManager - XML Controller Info Resolver found invalid controller host information [] in controller-info.xml; Please specify a valid value if it is not already set in system properties. [AD Agent init] 10 Sep 2022 02:14:49,166 WARN XMLConfigManager - XML Controller Info Resolver found invalid controller port information [] in controller-info.xml; Please specify a valid value if it is not already set in system properties. [AD Agent init] 10 Sep 2022 02:14:49,169 WARN XMLConfigManager - XML Controller Info Resolver found invalid controller host information [] in controller-info.xml; Please specify a valid value if it is not already set in system properties. [AD Agent init] 10 Sep 2022 02:14:49,169 WARN XMLConfigManager - XML Controller Info Resolver found invalid controller port information [] in controller-info.xml; Please specify a valid value if it is not already set in system properties. [AD Agent init] 10 Sep 2022 02:14:49,172 INFO XMLConfigManager - XML Agent Account Info Resolver did not find account name. Using default account name [customer1] [AD Agent init] 10 Sep 2022 02:14:49,172 WARN XMLConfigManager - XML Agent Account Info Resolver did not find account access key. [AD Agent init] 10 Sep 2022 02:14:49,173 INFO XMLConfigManager - Configuration Channel is using ControllerInfo:: host:[appdynamics-prd.getnet.com.br] port:[8090] sslEnabled:[unknown] keystoreFile:[DEFAULT:cacerts.jks] use-encrypted-credentials:[false] secureCredentialStoreFileName:[] secureCredentialStorePassword:[] use-ssl-client-auth:[false] asymmetricKeysStoreFilename:[] asymmetricKeysStorePassword:[] asymmetricKeyPassword:[] asymmetricKeyAlias:[] validation:[UNSPECIFIED] [AD Agent init] 10 Sep 2022 02:14:49,470 INFO XMLConfigManager - Read property [reuse node name] from environment variable [APPDYNAMICS_JAVA_AGENT_REUSE_NODE_NAME] [AD Agent init] 10 Sep 2022 02:14:50,065 INFO XMLConfigManager - Agent AWS instance-id retrieval enabled: true [AD Agent init] 10 Sep 2022 02:14:50,065 INFO XMLConfigManager - Agent Azure instance-id retrieval enable:true [AD Agent init] 10 Sep 2022 02:14:50,065 INFO XMLConfigManager - Agent GCP instance-id retrieval enable:true [AD Agent init] 10 Sep 2022 02:14:50,162 INFO AgentConfigWatchdog - Agent overwrite set to false [AD Agent init] 10 Sep 2022 02:14:50,166 INFO SensitiveDataScrubber - Parsed 8 filters from <sensitive-data-filters> section [AD Agent init] 10 Sep 2022 02:14:50,167 INFO SensitiveDataScrubber - Parsed 0 filters from <sensitive-url-filters> section [AD Agent init] 10 Sep 2022 02:14:50,168 INFO SensitiveDataScrubber - Parsed 0 filters from <sensitive-message-filters> section [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for TransactionMonitoringService = [{async-instrumentation-strategy=AgentConfigPropertyValue{value='executor', origin=APP_AGENT_CONFIG, mutable=true}, config-file-path=AgentConfigPropertyValue{value='transactions.xml', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for JMXService = [{jmx-gc-majorCollectionBean=AgentConfigPropertyValue{value='', origin=APP_AGENT_CONFIG, mutable=true}, jmx-gc-minorCollectionBean=AgentConfigPropertyValue{value='', origin=APP_AGENT_CONFIG, mutable=true}, jmx-server-metrics-update-interval-in-seconds=AgentConfigPropertyValue{value='60', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for ObjectMonitoringService = [{enable-collection-monitoring=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, minimum-age-for-evaluation-in-minutes=AgentConfigPropertyValue{value='30', origin=APP_AGENT_CONFIG, mutable=true}, enable-object-size-monitoring=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, minimum-size-for-evaluation-in-mb=AgentConfigPropertyValue{value='5', origin=APP_AGENT_CONFIG, mutable=true}, disable-collection-capture=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, enable-instance-monitoring=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, collection-capture-period-in-minutes=AgentConfigPropertyValue{value='30', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for AgentDiagnosticsService = [{enable-thread-dump=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, dump-all-threads=AgentConfigPropertyValue{value='true', origin=APP_AGENT_CONFIG, mutable=true}, thread-dump-logger=AgentConfigPropertyValue{value='log4j', origin=APP_AGENT_CONFIG, mutable=true}, enable-shutdown-hook=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, thread-dump-interval=AgentConfigPropertyValue{value='300', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for InstrumentationSdkPluginManager = [{sdk-plugin-directory=AgentConfigPropertyValue{value='sdk-plugins', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for DynamicServiceManager = [{enable-jar-signing=AgentConfigPropertyValue{value='false', origin=APP_AGENT_CONFIG, mutable=true}, external-service-directory=AgentConfigPropertyValue{value='external-services', origin=APP_AGENT_CONFIG, mutable=true}, signed-jar-certificate-filename=AgentConfigPropertyValue{value='', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,169 INFO AgentConfigWatchdog - Service properties for BCIEngine = [{exclude.classes.from.class.loader.2=AgentConfigPropertyValue{value='com.cisco.mtagent.boot.Controller$TenantClassLoader', origin=APP_AGENT_CONFIG, mutable=true}, exclude.classes.from.class.loader.1=AgentConfigPropertyValue{value='com.cisco.mtagent.entry.MTAgent$MultiTenantAgentClassLoader', origin=APP_AGENT_CONFIG, mutable=true}}] [AD Agent init] 10 Sep 2022 02:14:50,174 INFO XMLConfigManager - Node will be marked as historical at shutdown [AD Agent init] 10 Sep 2022 02:14:50,253 INFO AgentKernel - JVM Runtime: java.home=/usr/lib/jvm/java-11-openjdk-11.0.14.1.1-2.el8_5.x86_64 java.vm.vendor=Red Hat, Inc. java.vm.name=OpenJDK 64-Bit Server VM java.version=11.0.14.1 java.specification.version=11 java.runtime.version=11.0.14.1+1-LTS java.io.tmpdir=/tmp user.language=en user.country= user.variant= Default locale=en [AD Agent init] 10 Sep 2022 02:14:50,253 INFO AgentKernel - OS Runtime: os.name=Linux os.arch=amd64 os.version=4.18.0-305.57.1.el8_4.x86_64 user.name=? user.home=? user.dir=/home/jboss [AD Agent init] 10 Sep 2022 02:14:50,255 INFO AgentKernel - JVM Args : -Xms200M | -Xmx1G | -javaagent:/opt/app-dynamics/appdynamics/javaagent.jar | -Dappdynamics.jvm.shutdown.mark.node.as.historical=true | -Dappagent.start.timeout=3 | [AD Agent init] 10 Sep 2022 02:14:50,255 INFO AgentKernel - JVM Runtime Name: 14@payments-v2-gwproxy-8-2jvbw [AD Agent init] 10 Sep 2022 02:14:50,255 INFO AgentKernel - JVM PID: 14 [AD Agent init] 10 Sep 2022 02:14:50,256 INFO AgentKernel - No debugger attached [AD Agent init] 10 Sep 2022 02:14:50,975 INFO AnnotationPropertyListenerManager - Registered NodeProperty [max-metrics-allowed] to method [public void com.singularity.ee.agent.appagent.kernel.controller.metrics.MetricGenerationServiceFactory.setMaxMetricsAllowed(int)] in class class com.singularity.ee.agent.appagent.kernel.controller.metrics.MetricGenerationServiceFactory 1 [AD Agent init] 10 Sep 2022 02:14:50,976 INFO AnnotationPropertyListenerManager - Registered NodeProperty [max-metric-queue-length] to method [public void com.singularity.ee.agent.appagent.kernel.controller.metrics.MetricGenerationServiceFactory.setMetricPublishQueueLength(int)] in class class com.singularity.ee.agent.appagent.kernel.controller.metrics.MetricGenerationServiceFactory 1 [AD Agent init] 10 Sep 2022 02:14:50,976 INFO MetricHandler - Initialized with maximum number of metrics allowed of 5000 [AD Agent init] 10 Sep 2022 02:14:51,056 INFO MetricHandler - Initialized with maxPublishQueueLength [2], aggregationFrequencyInMillis [60000] [AD Agent init] 10 Sep 2022 02:14:51,058 INFO MetricHandler - Metric Service is : [enabled]. [AD Agent init] 10 Sep 2022 02:14:51,062 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-kafka-consumer] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.kafka.KafkaConfiguration.setConsumerEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.kafka.KafkaConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,202 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-jvm-metrics-update-interval-in-seconds] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxServerMetricsUpdateIntervalInSeconds(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-appserver-mbean-finder-delay-in-seconds] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxServerMBeanFinderDelayInSeconds(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-memory-metric-retry-count] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxMemoryMetricRetryCount(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-metric-threshold-percentage] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setThresholdPercentatge(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-metric-threshold-percentatge] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setThresholdPercentatgeForMisspelledKey(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-data-collection] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxDataEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-appserver] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxAppserverEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-jvm-metrics-update-interval-in-seconds] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxJVMMetricsUpdateIntervalInSeconds(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 2 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-appserver-mbean-finder-retries] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setJmxServerMBeanFinderRetries(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,203 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-exclude-objectnames-with-wildcards] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setExcludeObjectNamesWithWildcards(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,204 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-agent-resource-tracker] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setAgentResourceEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,204 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-max-metrics-to-report] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setMaxJMXMetricToReport(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,204 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-jmx-metric-timer] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.setEnableTimer(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,204 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-query-fallback-to-attribute-for-operation] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig.isFallbackToAttributeForOperation(boolean)] in class class com.singularity.ee.agent.appagent.services.jmxservice.JMXServiceConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,208 INFO WebSphereMBeanServerChecker - javax.management.builder.initial = [ null] [AD Agent init] 10 Sep 2022 02:14:51,208 INFO WebSphereMBeanServerChecker - WebSphere is using a special MBean server [false] [AD Agent init] 10 Sep 2022 02:14:51,373 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-vertx-http] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.vertx.http.VertxHttpConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.vertx.http.VertxHttpConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,374 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-vertx-message-entry] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.vertx.message.VertxMessageEntryConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.vertx.message.VertxMessageEntryConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,375 INFO AnnotationPropertyListenerManager - Registered NodeProperty [max-transformation-per-interceptor] to method [public void com.singularity.ee.agent.appagent.services.bciengine.spi.TransformationLimiterConfig.setMaxTransformationPerInterceptor(int)] in class class com.singularity.ee.agent.appagent.services.bciengine.spi.TransformationLimiterConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,375 INFO AnnotationPropertyListenerManager - Registered NodeProperty [should-inline-interceptors] to method [public void com.singularity.ee.agent.appagent.services.bciengine.inline.template.InlineRetransformationHelper.setShouldInline(boolean)] in class class com.singularity.ee.agent.appagent.services.bciengine.inline.template.InlineRetransformationHelper 1 [AD Agent init] 10 Sep 2022 02:14:51,452 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-mule-message-interceptor] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.esb.mule.correlation.MuleMessageGUIDConfiguration.setMuleMessageGUIDInterceptorEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.esb.mule.correlation.MuleMessageGUIDConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,453 INFO AnnotationPropertyListenerManager - Registered NodeProperty [spring-mvc-naming-scheme] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.spring.mvc.SpringMVCNamingConfiguration.changeProperty(java.lang.String)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.spring.mvc.SpringMVCNamingConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,455 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-akka-metrics] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.scala.akka.AkkaConfiguration.setEnableMetrics(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.scala.akka.AkkaConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,456 INFO AnnotationPropertyListenerManager - Registered NodeProperty [turbo-bypass-hotspot-clock] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.exitpoint.TurboExitPropertyListener.setMaxTransformationPerInterceptor(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.exitpoint.TurboExitPropertyListener 1 [AD Agent init] 10 Sep 2022 02:14:51,459 INFO AnnotationPropertyListenerManager - Registered NodeProperty [disable-ibmbpm-usertask-bt-naming] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.rest.IbmBpmUserTaskBTNamingConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.rest.IbmBpmUserTaskBTNamingConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,460 INFO AnnotationPropertyListenerManager - Registered NodeProperty [ibmbpm-systemtask-bt-naming] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.pojo.IbmBpmSystemTaskBTNamingConfiguration.changeProperty(java.lang.String)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.pojo.IbmBpmSystemTaskBTNamingConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,460 INFO IbmBpmSystemTaskBTNamingConfiguration - IBM-BPM SystemTask BT Naming scheme has been set to default. [AD Agent init] 10 Sep 2022 02:14:51,461 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-axon-entry] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.axon.AxonConfiguration.setAxonEntryEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.axon.AxonConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,461 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-axon-exit] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.axon.AxonConfiguration.setAxonExitEnabled(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.axon.AxonConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,462 INFO AnnotationPropertyListenerManager - Registered NodeProperty [disable-ibmbpm-data-collectors] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.IbmBpmDataCollectorConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.IbmBpmDataCollectorConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,464 INFO AnnotationPropertyListenerManager - Registered NodeProperty [disable-ibmbpm-usertask-bt-in-process-correlation] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.rest.IbmBpmUserTaskBTInProcessCorrelationConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.ibmbpm.rest.IbmBpmUserTaskBTInProcessCorrelationConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,465 INFO AnnotationPropertyListenerManager - Registered NodeProperty [skip-jms-listener-for-bt-naming] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.jms.message.JMSMessageConfiguration.changeProperty(java.lang.String)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.jms.message.JMSMessageConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,466 INFO AnnotationPropertyListenerManager - Registered NodeProperty [osb-ignore-exit-types] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.esb.osb.OSBGenericExitConfiguration.changeProperty(java.lang.String)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.esb.osb.OSBGenericExitConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,470 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-webclient] to method [public void com.singularity.ee.agent.appagent.services.transactionmonitor.http.correlation.webflux.webclient.WebClientConfiguration.changeProperty(boolean)] in class class com.singularity.ee.agent.appagent.services.transactionmonitor.http.correlation.webflux.webclient.WebClientConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,475 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-cache-refresh-time] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.appserver.common.JMXAttributeDefinitionCacheConfig.setCacheTimeoutInMinutes(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.appserver.common.JMXAttributeDefinitionCacheConfig 1 [AD Agent init] 10 Sep 2022 02:14:51,566 INFO MemoryUsageGenerator - Identified minor collection bean :Copy [AD Agent init] 10 Sep 2022 02:14:51,566 INFO MemoryUsageGenerator - Identified major collection bean :MarkSweepCompact [AD Agent init] 10 Sep 2022 02:14:51,577 INFO AnnotationPropertyListenerManager - Registered NodeProperty [deserialization-whitelist-update-enabled] to method [public void com.singularity.ee.agent.util.serialize.DeserializationWhitelistListener.setDeserializationWhitelistUpdateEnabled(boolean)] in class class com.singularity.ee.agent.util.serialize.DeserializationWhitelistListener 1 [AD Agent init] 10 Sep 2022 02:14:51,653 INFO AgentKernel - Open Telemetry tracing is disabled. To enable, please configure at system property. [AD Agent init] 10 Sep 2022 02:14:51,653 INFO LifeCycleManager - Starting service [JMXService] [AD Agent init] 10 Sep 2022 02:14:51,660 INFO AnnotationPropertyListenerManager - Registered NodeProperty [jmx-operation-timeout-in-milliseconds] to method [public void com.singularity.ee.agent.appagent.services.jmxservice.transientoperations.JMXTransientOperationsHandler.setJMXOperationTimeoutProperty(int)] in class class com.singularity.ee.agent.appagent.services.jmxservice.transientoperations.JMXTransientOperationsHandler 1 [AD Agent init] 10 Sep 2022 02:14:51,672 INFO JMXService - ###### Using config from controller for JMX operations ######### [AD Agent init] 10 Sep 2022 02:14:51,676 INFO MemoryUsageGenerator - Identified minor collection bean :Copy [AD Agent init] 10 Sep 2022 02:14:51,676 INFO MemoryUsageGenerator - Identified major collection bean :MarkSweepCompact [AD Agent init] 10 Sep 2022 02:14:51,677 INFO MemoryMetricGenerator - Initialized Minor Collection GC metrics [AD Agent init] 10 Sep 2022 02:14:51,677 INFO MemoryMetricGenerator - Initialized Major Collection GC metrics [AD Agent init] 10 Sep 2022 02:14:51,677 INFO MemoryMetricGenerator - Initialized Overall GC metrics [AD Agent init] 10 Sep 2022 02:14:51,679 INFO MemoryMetricGenerator - Initialized Memory Pool MX Beans, CodeHeap 'non-nmethods', Metaspace, Tenured Gen, CodeHeap 'profiled nmethods', Eden Space, Survivor Space, Compressed Class Space, CodeHeap 'non-profiled nmethods' [AD Agent init] 10 Sep 2022 02:14:51,680 INFO JVMMetricReporter - Number of processors 1 [AD Agent init] 10 Sep 2022 02:14:51,753 INFO JMXService - JVM JMX Metric collection initialized with update interval [60] seconds [AD Agent init] 10 Sep 2022 02:14:51,753 INFO LifeCycleManager - Started service [JMXService] [AD Agent init] 10 Sep 2022 02:14:51,753 INFO LifeCycleManager - Starting service [LogParserService] [AD Agent init] 10 Sep 2022 02:14:51,754 INFO LifeCycleManager - Service instantiated reflectively LogParserService :classcom.singularity.ee.agent.appagent.services.LogEventService [AD Agent init] 10 Sep 2022 02:14:51,756 INFO LifeCycleManager - Started service [LogParserService] [AD Agent init] 10 Sep 2022 02:14:51,756 INFO LifeCycleManager - Starting service [Agent17Service] [AD Agent init] 10 Sep 2022 02:14:51,756 INFO LifeCycleManager - Service instantiated reflectively Agent17Service :classcom.singularity.ee.agent.appagent.services.java17.Java17AgentService [AD Agent init] 10 Sep 2022 02:14:51,757 INFO LifeCycleManager - Started service [Agent17Service] [AD Agent init] 10 Sep 2022 02:14:51,757 INFO LifeCycleManager - Starting service [DynamicServiceManager] [AD Agent init] 10 Sep 2022 02:14:51,761 INFO AnnotationPropertyListenerManager - Registered NodeProperty [enable-datapipeline-dynamic-service] to method [public void com.singularity.ee.agent.appagent.kernel.dynamicservice.services.DataPipelineConfiguration.enableDataPipeline(boolean)] in class class com.singularity.ee.agent.appagent.kernel.dynamicservice.services.DataPipelineConfiguration 1 [AD Agent init] 10 Sep 2022 02:14:51,762 INFO LifeCycleManager - Started service [DynamicServiceManager] [AD Agent init] 10 Sep 2022 02:14:51,762 INFO LifeCycleManager - Starting service [BCIEngine] [AD Agent init] 10 Sep 2022 02:14:51,763 INFO ADeferredClassRetransformer - Preference to retransform classes = false [AD Agent init] 10 Sep 2022 02:14:51,765 WARN LifeCycleManager - Could not start service [BCIEngine] java.lang.ClassCastException: class java.lang.Boolean cannot be cast to class java.lang.String (java.lang.Boolean and java.lang.String are in module java.base of loader 'bootstrap') at com.singularity.ee.agent.appagent.services.bciengine.BCIEngineService.getClassLookaheadFilters(BCIEngineService.java:367) ~[appagent-boot.jar:?] at com.singularity.ee.agent.appagent.services.bciengine.BCIEngineService.setServiceContext(BCIEngineService.java:332) ~[appagent-boot.jar:?] at com.singularity.ee.agent.appagent.kernel.LifeCycleManager.startService(LifeCycleManager.java:347) ~[appagent.jar:?] at com.singularity.ee.agent.appagent.kernel.LifeCycleManager.startServices(LifeCycleManager.java:308) ~[appagent.jar:?] at com.singularity.ee.agent.appagent.kernel.AgentKernel.start(AgentKernel.java:165) ~[appagent.jar:?] at com.singularity.ee.agent.appagent.kernel.JavaAgent.initialize(JavaAgent.java:480) ~[appagent-boot.jar:?] at com.singularity.ee.agent.appagent.kernel.JavaAgent.initialize(JavaAgent.java:355) ~[appagent-boot.jar:?] sh-4.4$