topic Getting error post installing Linux Monitoring Extension to monitor NFS in Splunk AppDynamics

Getting error post installing Linux Monitoring Extension to monitor NFS

Shubham_Kadam — Mon, 06 May 2024 08:02:52 GMT

Hi All,

I have installed Linux monitoring extension to get the NFS utilization metrics as per this documentation

https://developer.cisco.com/codeexchange/github/repo/Appdynamics/linux-monitoring-extension/#readme

but post doing necessary changes as per documentation, i have restarted machine-agent. i am getting this error while startup. Please check and let me know the solution.

[rinst@vm-64e6db337156cc18f93ef923 logs]$ cat machine-agentstartup.log

my-vm==> [main] 06 May 2024 07:40:06,143 INFO FlexibleX509TrustManager - Using default keystore for SSL certificate validation.

my-vm==> [main] 06 May 2024 07:40:06,446 INFO HostIdProvider - Default Host Identifier Resolver using host name for unique host identifier [my-vm]

my-vm==> [main] 06 May 2024 07:40:06,549 INFO MachineLicensePropertiesProvider - Detected Virtual CPU Count: 4

my-vm==> [main] 06 May 2024 07:40:06,549 INFO MachineLicensePropertiesProvider - Detected Logical CPU Count: 4

my-vm==> [main] 06 May 2024 07:40:06,549 INFO MachineLicensePropertiesProvider - Detected Physical CPU Count: 4

my-vm==> [system-thread-0] 06 May 2024 07:40:06,970 INFO SecondStageSystem - Starting main system with features Features(features=[dmm, sim], reason=Features.Reason(message=, code=))

my-vm==> [system-thread-0] 06 May 2024 07:40:07,206 INFO SystemAgent - ####################################################################################

my-vm==> [system-thread-0] 06 May 2024 07:40:07,206 INFO SystemAgent - Agent Install Directory [/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,206 INFO SystemAgent - Using Agent Version [Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,207 INFO SystemAgent - JVM Runtime:

java.home=/ngs/app/rinst/applejdk-11.0.16.8.1

java.vm.vendor=Apple Inc.

java.vm.name=OpenJDK 64-Bit Server VM

java.version=11.0.16

java.specification.version=11

java.runtime.version=11.0.16+8-20220720170112

java.io.tmpdir=/tmp

user.language=en

user.country=US

user.variant=

Default locale=en_US

my-vm==> [system-thread-0] 06 May 2024 07:40:07,207 INFO SystemAgent - OS Runtime:

os.name=Linux

os.arch=amd64

os.version=4.18.0-477.51.1.el8_8.x86_64

user.name=rinst

user.home=/ngs/app/rinst

user.dir=/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23

my-vm==> [system-thread-0] 06 May 2024 07:40:07,207 INFO SystemAgent - JVM Args : -Xmx256m | -Dlog4j.configuration=file:/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/conf/logging/log4j.xml |

my-vm==> [system-thread-0] 06 May 2024 07:40:07,211 INFO SystemAgent - JVM Runtime Name: 2589878@my-vm

my-vm==> [system-thread-0] 06 May 2024 07:40:07,211 INFO SystemAgent - JVM PID: 2589878

my-vm==> [system-thread-0] 06 May 2024 07:40:07,211 INFO SystemAgent - Machine Agent is resolving bootstrap info....

my-vm==> [system-thread-0] 06 May 2024 07:40:07,299 INFO SystemAgent - Orchestration is disabled - disabling virtualization resolvers by default.

my-vm==> [system-thread-0] 06 May 2024 07:40:07,303 WARN ContainerIdExtractor - Unable to use /proc/self/cgroup for unique hostname, could not locate container ID

my-vm==> [system-thread-0] 06 May 2024 07:40:07,305 INFO SystemAgent - Full Agent Registration Info Resolver found system property [appdynamics.agent.create.agent.info.if.missing] for appdynamics.agent.create.agent.info.if.missing [false]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,313 INFO SystemAgent - Default Host Identifier Resolver using host name for unique host identifier [my-vm]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,315 INFO SystemAgent - Default IP Address Resolver found IP addresses [[fe80:0:0:0:889b:9bd4:a19a:6e79%eth0, 17.182.56.82]]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,319 INFO SystemAgent - Full Agent Registration Info Resolver using selfService [false]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,319 INFO SystemAgent - Full Agent Registration Info Resolver using ephemeral node setting [false]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,319 INFO SystemAgent - Full Agent Registration Info Resolver using application name [null]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,320 INFO SystemAgent - Full Agent Registration Info Resolver using tier name [null]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,320 INFO SystemAgent - Full Agent Registration Info Resolver using node name [null]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,323 INFO SystemAgent - XML Controller Info Resolver found controller host [rins-appd-stg.apple.com]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,323 INFO SystemAgent - XML Controller Info Resolver found controller port [443]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,326 INFO SystemAgent - XML Agent Account Info Resolver using account name [customer1]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,326 INFO SystemAgent - XML Agent Account Info Resolver using account access key [****]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,329 INFO SystemAgent - Keystore file /ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/conf/cacerts.jks was not found

my-vm==> [system-thread-0] 06 May 2024 07:40:07,340 INFO SystemAgent - Machine Agent resolved bootstrap info!

my-vm==> [system-thread-0] 06 May 2024 07:40:07,340 INFO SystemAgent - Creating machine agent scheduler, pool size: 2

my-vm==> [system-thread-0] 06 May 2024 07:40:07,349 INFO SystemAgent - Creating machine agent monitor scheduler, pool size: 4

my-vm==> [system-thread-0] 06 May 2024 07:40:07,353 INFO SystemAgent - Started Agent Schedulers

my-vm==> [ConfigExecutor-0] 06 May 2024 07:40:07,366 INFO DefaultLegacyAgentRegistrationStateManager - Registered machine with machine ID [Optional.of(14786)]

my-vm==> [ConfigExecutor-0] 06 May 2024 07:40:07,367 INFO DefaultLegacyAgentRegistrationStateManager - Scheduling System-Agent start...

my-vm==> [system-thread-0] 06 May 2024 07:40:07,372 INFO SimAgentRepetitiveLoggingModule - The turnover time for the SIM agent repetitive logger is 5 minutes

my-vm==> [system-thread-0] 06 May 2024 07:40:07,372 INFO SimAgentRepetitiveLoggingModule - The cache size for the SIM agent repetitive logger is 1000

my-vm==> [system-thread-0] 06 May 2024 07:40:07,577 INFO Fabric8Client - No Kubernetes was detected.

my-vm==> [system-thread-0] 06 May 2024 07:40:07,596 WARN DynamicMonitoringModeTask - Encountered error checking monitoring mode. Will retry in 60 seconds.

my-vm==> [system-thread-0] 06 May 2024 07:40:07,596 INFO DefaultLegacyAgentRegistrationStateManager - Starting machine agent...

my-vm==> [system-thread-0] 06 May 2024 07:40:07,596 INFO SystemAgent - Starting Machine Agent....

my-vm==> [system-thread-0] 06 May 2024 07:40:07,597 INFO ControllerTimeSkewHandler - Skew Handler is : [enabled].

my-vm==> [system-thread-0] 06 May 2024 07:40:07,634 INFO SystemAgent - Full certificate chain validation performed using default certificate file

my-vm==> [system-thread-0] 06 May 2024 07:40:07,682 INFO ManagedMonitorDelegate - Started Agent Metric Generation Service

my-vm==> [system-thread-0] 06 May 2024 07:40:07,688 INFO ManagedMonitorDelegate - Event Service is : [enabled].

my-vm==> [system-thread-0] 06 May 2024 07:40:07,697 INFO ManagedMonitorDelegate - Initialized with maxPublishQueueLength [2], aggregationFrequencyInMillis [60000]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,699 INFO ManagedMonitorDelegate - Metric Service is : [enabled].

my-vm==> [system-thread-0] 06 May 2024 07:40:07,702 INFO ManagedMonitorDelegate - Started Agent Env Properties Service

my-vm==> [system-thread-0] 06 May 2024 07:40:07,704 INFO ManagedMonitorDelegate - Scheduled Continuous Task Monitor with frequency [30000]ms

my-vm==> [system-thread-0] 06 May 2024 07:40:07,705 INFO NodeMonitorManager - Not running legacy system-agent monitor because SIM is enabled.

my-vm==> [system-thread-0] 06 May 2024 07:40:07,709 INFO MonitorConfigReader - Reading monitor config file:/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/monitors/analytics-agent/monitor.xml

my-vm==> [system-thread-0] 06 May 2024 07:40:07,720 INFO MonitorConfigReader - os name [linux] version [4.18.0-477.51.1.el8_8.x86_64]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,725 INFO NodeMonitorManager - Initializing managed monitor [analytics-agent]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,725 INFO ManagedMonitorDelegate - Initializing managed monitor [AppDynamics Analytics Agent]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,725 INFO ManagedMonitorDelegate - Executing managed monitor [AppDynamics Analytics Agent], task name [null]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,725 INFO ManagedMonitorDelegate - Task [null] for monitor [AppDynamics Analytics Agent] is SCHEDULED

my-vm==> [system-thread-0] 06 May 2024 07:40:07,743 INFO InProcessLauncherTask - Found a directory [/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/monitors/analytics-agent/lib]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,756 INFO InProcessLauncherTask - Working directory appears to be [/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/monitors/analytics-agent]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,758 INFO AnalyticsAgentLauncher - The logs directory property [ad.dw.log.path] has been set to [/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/logs]

my-vm==> [system-thread-0] 06 May 2024 07:40:07,758 INFO InProcessLauncherTask - Starting to execute actual task with parameters [{csvMethodArgs=/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/monitors/analytics-agent/conf/analytics-agent.properties, methodName=main, className=com.appdynamics.analytics.agent.AnalyticsAgent}]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,348 INFO InProcessLauncherTask - Started [com.appdynamics.analytics.agent.AnalyticsAgent]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,349 INFO MonitorConfigReader - Reading monitor config file:/ngs/app/rinst/machineagent-bundle-64bit-linux-aarch64-23/monitors/LinuxMonitor/monitor.xml

my-vm==> [system-thread-0] 06 May 2024 07:40:13,355 INFO MonitorConfigReader - os name [linux] version [4.18.0-477.51.1.el8_8.x86_64]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,357 INFO NodeMonitorManager - Initializing managed monitor [LinuxMonitor]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,357 INFO ManagedMonitorDelegate - Initializing managed monitor [LinuxMonitor]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,357 INFO ManagedMonitorDelegate - Executing managed monitor [LinuxMonitor], task name [Linux Monitor Run Task]

my-vm==> [system-thread-0] 06 May 2024 07:40:13,357 INFO ManagedMonitorDelegate - Task [Linux Monitor Run Task] is periodic

my-vm==> [system-thread-0] 06 May 2024 07:40:13,379 ERROR JavaTaskCreator - Could not load/instantiate the Java Task Main class for Java task [Linux Monitor Run Task]

java.lang.NoClassDefFoundError: org/apache/log4j/Layout

at java.lang.Class.getDeclaredConstructors0(Native Method) ~[?:?]

at java.lang.Class.privateGetDeclaredConstructors(Class.java:3137) ~[?:?]

at java.lang.Class.getConstructor0(Class.java:3342) ~[?:?]

at java.lang.Class.newInstance(Class.java:556) ~[?:?]

at com.singularity.ee.agent.systemagent.task.JavaTaskCreator.createJavaTask(JavaTaskCreator.java:69) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.MonitorTaskRunner.createTask(MonitorTaskRunner.java:75) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.PeriodicTaskRunner.<init>(PeriodicTaskRunner.java:41) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.ManagedMonitorDelegate.setupEnvTask(ManagedMonitorDelegate.java:255) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.ManagedMonitorDelegate.initializeMonitor(ManagedMonitorDelegate.java:212) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.NodeMonitorManager.readConfig(NodeMonitorManager.java:178) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.NodeMonitorManager.startAllMonitors(NodeMonitorManager.java:265) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.NodeMonitorManager.<init>(NodeMonitorManager.java:79) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.AgentMonitorManager.<init>(AgentMonitorManager.java:63) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.Agent.setupMonitorManager(Agent.java:492) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.Agent.startServices(Agent.java:399) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.SystemAgent.startServices(SystemAgent.java:79) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.Agent.start(Agent.java:384) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.appdynamics.agent.sim.legacy.DefaultLegacyAgentRegistrationStateManager$1.run(DefaultLegacyAgentRegistrationStateManager.java:80) [machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]

at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]

at java.lang.Thread.run(Thread.java:829) [?:?]

Caused by: java.lang.ClassNotFoundException: org.apache.log4j.Layout

at com.singularity.ee.util.loader.FileSystemClassLoader.findClass(FileSystemClassLoader.java:372) ~[agent-23.4.0-845.jar:?]

at java.lang.ClassLoader.loadClass(ClassLoader.java:589) ~[?:?]

at com.singularity.ee.util.loader.FileSystemClassLoader.loadClass(FileSystemClassLoader.java:320) ~[agent-23.4.0-845.jar:?]

at java.lang.ClassLoader.loadClass(ClassLoader.java:522) ~[?:?]

... 24 more

my-vm==> [system-thread-0] 06 May 2024 07:40:13,387 WARN ManagedMonitorDelegate - Error executing managed monitor [LinuxMonitor], task name [Linux Monitor Run Task]

com.singularity.ee.agent.systemagent.api.exception.TaskInstantiationException: Could not load/instantiate task main class[com.appdynamics.extensions.linux.LinuxMonitor] for task [Linux Monitor Run Task]

at com.singularity.ee.agent.systemagent.task.JavaTaskCreator.createJavaTask(JavaTaskCreator.java:90) ~[machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.MonitorTaskRunner.createTask(MonitorTaskRunner.java:75) ~[machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.PeriodicTaskRunner.<init>(PeriodicTaskRunner.java:41) ~[machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]

at com.singularity.ee.agent.systemagent.components.monitormanager.managed.ManagedMonitorDelegate.setupEnvTask(ManagedMonitorDelegate.java:255) ~[machineagent.jar:Machine Agent v23.2.0.3568 GA compatible with 4.4.1.0 Build Date 2023-02-21 10:37:10]