AppD Archive

Database Monitoring - Agent - ERROR DBEntitySubscriber - HTTP 500

CommunityUser
Splunk Employee
Splunk Employee

Currently the Database Agent is installed, and this is the error message we're getting since the installation and initial run:

14:42:06,453 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Request failed: HTTP/1.1 500 Internal Server Error

They are all SQL Server 2012, the user is part of the SysAdmin role.

See that individually no data is shown on the "Dasboard"page

image.png

image.png

image.png

image.png

image.png

Log is also attached.

Please advise.

Thanks.

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I also tried to add two DB2 instances to the monitoring, but it complains about the moniroing switches not being ON.

Below will find the information, and attached, the logs.

"Q$"

db2 => GET MONITOR SWITCHES

            Monitor Recording Switches

Switch list for db partition number 0
Buffer Pool Activity Information  (BUFFERPOOL) = ON  02/17/2015 15:25:23.577411
Lock Information                        (LOCK) = ON  02/17/2015 15:25:23.577411
Sorting Information                     (SORT) = ON  02/17/2015 15:25:23.577411
SQL Statement Information          (STATEMENT) = ON  02/17/2015 15:25:23.577411
Table Activity Information             (TABLE) = ON  02/17/2015 15:25:23.577411
Take Timestamp Information         (TIMESTAMP) = ON  02/04/2015 21:28:08.021113
Unit of Work Information                 (UOW) = ON  02/17/2015 15:25:23.577411

"P$"

db2 => GET MONITOR SWITCHES

            Monitor Recording Switches

Switch list for db partition number 0
Buffer Pool Activity Information  (BUFFERPOOL) = ON  02/17/2015 15:26:57.428772
Lock Information                        (LOCK) = ON  02/17/2015 15:26:57.428772
Sorting Information                     (SORT) = ON  02/17/2015 15:26:57.428772
SQL Statement Information          (STATEMENT) = ON  02/17/2015 15:26:57.428772
Table Activity Information             (TABLE) = ON  02/17/2015 15:26:57.428772
Take Timestamp Information         (TIMESTAMP) = ON  12/04/2014 21:08:36.493663
Unit of Work Information                 (UOW) = ON  02/17/2015 15:26:57.428772

0 Karma

Arun_Dasetty
Super Champion

Hi,

Can you confirm whether you executed the below sql commands as suggested in error message:

15:34:02,141 ERROR [Agent-Monitor-Scheduler-3] ADBCollector:211 - Error collecting data for database 'Q$AP-APM-DB2 01 fxdb'
java.lang.IllegalStateException: [Agent Error] The following monitor flags need to be switched on. ( BUFFERPOOL, LOCK, SORT, STATEMENT, TABLE, TIMESTAMP, UOW ).
[Info] You can enable the monitoring switches by the following commands:
update dbm cfg using dft_mon_stmt on;
update dbm cfg using dft_mon_timestamp on;

Or the output provided on switches are from corresponding database instance itself? please issue above sql and see if that makes any difference

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

I'm also addind the server logs here.

0 Karma

Arun_Dasetty
Super Champion

Hi,

We earlier see such issues when events service have issues as account name is missing and when we set it to customer1 global account name and it worked earlier:
ex: in analytics-all.properties file:

ad.account.name=customer1
ad.account.accessKey=SJ5b2m7d1$354

Set ad.account.name property value to Setup -> License -> copy value for customer1 global account name field in your controller UI and see how it goes with restart of event service "controller.sh stop-events-service"

if above suggestion does not help,Could you please attach the following details for our review to assist you further:
- analytics-all.log located at <controller_install_dir>\logs
- startup.log located at <controller_install_dir>/events_service/analytics-processor
- zipped version of file pattern analytics-*.properties  located at <controller_install_dir>/events_service/analytics-processor/conf
- <controller-install-dr>/logs/analytics-all-http.log
- <controller-install-dir>/events_service/analytics-processor/logs

Also let  us know if this is an upgraded controller setup

Regards,

Arun

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hello,

I think, i Have the same problem :

I just installed the trial version to monitor my Oracle DB and I have these errors :

11:58:43,641 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Request failed: HTTP/1.1 500 Internal Server Error
11:58:43,643 WARN [AD Thread-Metric Reporter0] DBEntitySubscriber:202 - Problem reporting measurements: null
11:58:43,643 WARN [AD Thread-Metric Reporter0] DBEntitySubscriber:212 - Error reading the response.
com.singularity.ee.rest.ResponseReadException: Error in HTTP Communication - null
at com.singularity.ee.rest.controller.request.ABinaryControllerRequest.<init>(ABinaryControllerRequest.java:50)
at com.singularity.ee.rest.controller.request.dbmon.WaitTimeMeasurementCollectorRequest.<init>(WaitTimeMeasurementCollectorRequest.java:34)
at com.singularity.ee.agent.dbagent.service.dbmonitorservice.DBEntitySubscriber.reportMeasurements(DBEntitySubscriber.java:208)
at com.singularity.ee.agent.dbagent.service.dbmonitorservice.DBMonitorService.reportMeasurements(DBMonitorService.java:215)
at com.singularity.ee.agent.dbagent.service.dbmonitorservice.DBEntityReporter.run(DBEntityReporter.java:87)
at com.singularity.ee.util.javaspecific.scheduler.AgentScheduledExecutorServiceImpl$SafeRunnable.run(AgentScheduledExecutorServiceImpl.java:107)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at com.singularity.ee.util.javaspecific.scheduler.ADFutureTask$Sync.innerRunAndReset(ADFutureTask.java:335)
at com.singularity.ee.util.javaspecific.scheduler.ADFutureTask.runAndReset(ADFutureTask.java:152)
at com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.access$101(ADScheduledThreadPoolExecutor.java:117)
at com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.runPeriodic(ADScheduledThreadPoolExecutor.java:204)
at com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.run(ADScheduledThreadPoolExecutor.java:234)
at com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.runTask(ADThreadPoolExecutor.java:694)
at com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.run(ADThreadPoolExecutor.java:726)
at java.lang.Thread.run(Unknown Source)

Here you can find the key from analytics-all

# The account in the Controller to which this Analytics server is associated.
ad.account.name=customer1_8ae672d3-335f-4a40-ab4f-65d0db4369ac
ad.account.accessKey=SJ5b2m7d1$354

Can you Help me ?

0 Karma

Arun_Dasetty
Super Champion

Hi ,

Can you also confirm whether analytics-api.properties file is also updated with ad.account,name and other details?

Can you send the agent logs and config files i requested in earlier post in addition to server.log from controller_dir/logs path if issue perists after issuing below steps:

controller-install-dir\bin> controller.bat stop_events_service
controller-install-dir\bin> controller.bat start-events-service

We see such errors in agent logs raises when event services is not started, events service are not started by default we need to manually start, let us know if that steps helps, please send requested logs if issue persists.

Regards,

Arun

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Many thanks !

With your commands :

C:\AppDynamics\Controller\bin>controller.bat start-events-service

C:\AppDynamics\Controller\bin>controller.bat start-events-service

All is working well !

Have a nice day !

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hi,

Yes, for the database error, it was needed to restart the DB2, once it was done, the UFFERPOOL, LOCK, SORT, STATEMENT, TABLE, TIMESTAMP, UOW ). was gone.

But still the error persist for the HTTP 500:

15:10:37,497 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Req
uest failed: HTTP/1.1 500 Internal Server Error
15:10:37,548 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Req
uest failed: HTTP/1.1 500 Internal Server Error
15:11:37,419 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Req
uest failed: HTTP/1.1 500 Internal Server Error
15:11:37,469 ERROR [AD Thread-Metric Reporter0] DBEntitySubscriber:30 - HTTP Req
uest failed: HTTP/1.1 500 Internal Server Error

0 Karma

CommunityUser
Splunk Employee
Splunk Employee

Hi, any idea here? I searched all the forums and documentation, there is nothing about the DBEntitySubscriber error.

Thanks.

0 Karma
Get Updates on the Splunk Community!

OpenTelemetry for Legacy Apps? Yes, You Can!

This article is a follow-up to my previous article posted on the OpenTelemetry Blog, "Your Critical Legacy App ...

UCC Framework: Discover Developer Toolkit for Building Technology Add-ons

The Next-Gen Toolkit for Splunk Technology Add-on Development The Universal Configuration Console (UCC) ...

.conf25 Community Recap

Hello Splunkers, And just like that, .conf25 is in the books! What an incredible few days — full of learning, ...