All Apps and Add-ons

SQL DBX Query is taking 500 seconds to execute the query

Ashwini008
Builder

Hi,

I am using dbxquery to fetch around 800000 data from database into splunk

| dbxquery connection=x query="select * from table002 " shortnames=t maxrows=800000

The above query is taking around 500 seconds.The default maxrow is 1000 in dbxquery.py script.How do reduce the time taken without impaction performance of my server?

P.S | noop search_optimization=false This doesnt improve my search time

 

Ashwini008_0-1631817021695.png

 

 

0 Karma

PickleRick
SplunkTrust
SplunkTrust

Firstly - do I understand correctly from your log that you're returning several hundred thousand records from db query and then do a search filtering it down to 27 records? If so, that's kinda... unwise.

Secondly - what's your memory status? (free, used, swap and so on. Are you not swapping out?

Thirdly - if you do a "normal" query using a bare cli client - does it also take that long? In short - are you sure it's splunk's fault?

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...