https://community.splunk.com/t5/All-Apps-and-Add-ons/SQL-DBX-Query-is-taking-500-seconds-to-execute-the-query/m-p/567307#M75151 <P>Firstly - do I understand correctly from your log that you're returning several hundred thousand records from db query and then do a search filtering it down to 27 records? If so, that's kinda... unwise.</P><P>Secondly - what's your memory status? (free, used, swap and so on. Are you not swapping out?</P><P>Thirdly - if you do a "normal" query using a bare cli client - does it also take that long? In short - are you sure it's splunk's fault?</P> Thu, 16 Sep 2021 19:03:21 GMT PickleRick 2021-09-16T19:03:21Z https://community.splunk.com/t5/All-Apps-and-Add-ons/SQL-DBX-Query-is-taking-500-seconds-to-execute-the-query/m-p/567304#M75150 <P>Hi,</P><P>I am using dbxquery to fetch around 800000 data from database into splunk</P><P>| dbxquery connection=x query="select * from table002 " shortnames=t maxrows=800000</P><P>The above query is taking around 500 seconds.The default maxrow is 1000 in dbxquery.py script.How do reduce the time taken without impaction performance of my server?</P><P>P.S&nbsp;| noop search_optimization=false This doesnt improve my search time</P><P>&nbsp;</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Ashwini008_0-1631817021695.png" style="width: 400px;"><img src="https://community.splunk.com/t5/image/serverpage/image-id/16015i667AC6528B1BE1E2/image-size/medium?v=v2&amp;px=400" role="button" title="Ashwini008_0-1631817021695.png" alt="Ashwini008_0-1631817021695.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P> Thu, 16 Sep 2021 18:30:30 GMT https://community.splunk.com/t5/All-Apps-and-Add-ons/SQL-DBX-Query-is-taking-500-seconds-to-execute-the-query/m-p/567304#M75150 Ashwini008 2021-09-16T18:30:30Z https://community.splunk.com/t5/All-Apps-and-Add-ons/SQL-DBX-Query-is-taking-500-seconds-to-execute-the-query/m-p/567307#M75151 <P>Firstly - do I understand correctly from your log that you're returning several hundred thousand records from db query and then do a search filtering it down to 27 records? If so, that's kinda... unwise.</P><P>Secondly - what's your memory status? (free, used, swap and so on. Are you not swapping out?</P><P>Thirdly - if you do a "normal" query using a bare cli client - does it also take that long? In short - are you sure it's splunk's fault?</P> Thu, 16 Sep 2021 19:03:21 GMT https://community.splunk.com/t5/All-Apps-and-Add-ons/SQL-DBX-Query-is-taking-500-seconds-to-execute-the-query/m-p/567307#M75151 PickleRick 2021-09-16T19:03:21Z