Splunk AppDynamics

Apache Kafka as backend Appdynamics 4.3x

CommunityUser
Splunk Employee
Splunk Employee

Hello, 

I am trying to instrument a java application Jboss/Wildfly, this application talks to Kafka backend... Although the wildfly shows up in Appdynamics dashboard, I am not able to see Kafka backend and I don't see any flow map.  Nothing shows up in Remote services even though backend detection is automatically enabled.  

I followed the steps on Remote Services article and Apache backend but somehow I don't see any backends being discovered. Is there a way I can troubleshoot this? 

https://docs.appdynamics.com/display/PRO44/Apache+Kafka+Consumer+Backends

https://community.appdynamics.com/t5/Knowledge-Base/Backend-Life-Cycle/ta-p/13985

I keep seeing this messages:

agent.2018_07_14__17_42_43.0.log:[AD Thread-Metric Reporter0] 14 Jul 2018 17:45:24,179 WARN DefaultJMXAttributeMetricReporter - Attribute not found for [fetch-latency-max] using mBeanName [ kafka.consumer:type=consumer-fetch-manager-metrics,client-id=consumer-2,topic=UpdateServiceHostsRequest ], in server [org.jboss.as.jmx.PluggableMBeanServerImpl@7d8a6321 ]

Labels (1)

CommunityUser
Splunk Employee
Splunk Employee

Ajay,

Did you get any solution? I am also trying same, instead of plain Producer, I am using streaming but same issues. No backend detection.

0 Karma

Peter_Holditch
Builder

Kafka is only detected as a back-end with in-built agent configuration for its publish/subscribe mode (and that support was introduced in v4.4, so agent versions prior to that will not detect it without custom configuration)

To detect its streaming mode, or to detect it in agent versions older than 4.4, you would need to create a custom exit point detection rule to match the API your application code is using.

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Peter,

I am using java agent version - 4.4.3 (SUBVERSION=22593). I was testing automatic detection of kafka calls against demo application provided as on kafka streams quick-start page. Here is the source code for spring boot kafka stream sample application. When I run with an agent, node is showing on AppDyanamics dashboard but no automatic kafka call detection.

To run attached source code - 

Follow steps 1, 2 and 3 as per stream quickstart page. Once you are done with creating topics. Run following commands to start the application.

//I asssume kakfa server is running on localhost:9092.
//In case it doesn't please change broker url in WordCountTaskFactory.java file

//on root of source code directory
>mvn clean install
//After build is successful, to start application >java -jar target\streams-wordcount-example-0.0.1-SNAPSHOT.jar

Now post some data to input topic - Step 5: Process some data 

0 Karma
Get Updates on the Splunk Community!

Say goodbye to manually analyzing phishing and malware threats with Splunk Attack ...

In today’s evolving threat landscape, we understand you’re constantly bombarded with phishing and malware ...

AppDynamics is now part of Splunk Ideas

Hello Splunkers, We have exciting news for you! AppDynamics has been added to the Splunk Ideas Portal. Which ...

Advanced Splunk Data Management Strategies

Join us on Wednesday, May 14, 2025, at 11 AM PDT / 2 PM EDT for an exclusive Tech Talk that delves into ...