All Apps and Add-ons

SQL DBX Query is taking 500 seconds to execute the query

Ashwini008
Builder

Hi,

I am using dbxquery to fetch around 800000 data from database into splunk

| dbxquery connection=x query="select * from table002 " shortnames=t maxrows=800000

The above query is taking around 500 seconds.The default maxrow is 1000 in dbxquery.py script.How do reduce the time taken without impaction performance of my server?

P.S | noop search_optimization=false This doesnt improve my search time

 

Ashwini008_0-1631817021695.png

 

 

0 Karma

PickleRick
SplunkTrust
SplunkTrust

Firstly - do I understand correctly from your log that you're returning several hundred thousand records from db query and then do a search filtering it down to 27 records? If so, that's kinda... unwise.

Secondly - what's your memory status? (free, used, swap and so on. Are you not swapping out?

Thirdly - if you do a "normal" query using a bare cli client - does it also take that long? In short - are you sure it's splunk's fault?

0 Karma
Get Updates on the Splunk Community!

Splunk Observability Cloud’s AI Assistant in Action Series: Analyzing and ...

This is the second post in our Splunk Observability Cloud’s AI Assistant in Action series, in which we look at ...

Elevate Your Organization with Splunk’s Next Platform Evolution

 Thursday, July 10, 2025  |  11AM PDT / 2PM EDT Whether you're managing complex deployments or looking to ...

Splunk Answers Content Calendar, June Edition

Get ready for this week’s post dedicated to Splunk Dashboards! We're celebrating the power of community by ...