https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255049#M3167 <P>I have a python script which returns all kinds of images via REST interface by going for some external sites to fetch them first. Apparently, the results of all such requests to the external sites are cached in <CODE>$SPLUNK_HOME/bin/.cache/</CODE>. Unfortunately, our requests are constantly changing, so, on one hand, we don't really need that cache much, and, on the other hand, that folder is growing because each request is a new one.</P> <P>At some point, Splunk stops all searches because the root partition has less than 5G free space. That's how we discovered bin/cache - by running around the whole system with <CODE>du</CODE> and looking for the offending folder.</P> <P>Are there any configuration settings allowing us to cap the size of bin/.cache somehow? I couldn't find anything in Splunk Admin manual.</P> Fri, 14 Oct 2016 18:06:13 GMT arkadyz1 2016-10-14T18:06:13Z https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255049#M3167 <P>I have a python script which returns all kinds of images via REST interface by going for some external sites to fetch them first. Apparently, the results of all such requests to the external sites are cached in <CODE>$SPLUNK_HOME/bin/.cache/</CODE>. Unfortunately, our requests are constantly changing, so, on one hand, we don't really need that cache much, and, on the other hand, that folder is growing because each request is a new one.</P> <P>At some point, Splunk stops all searches because the root partition has less than 5G free space. That's how we discovered bin/cache - by running around the whole system with <CODE>du</CODE> and looking for the offending folder.</P> <P>Are there any configuration settings allowing us to cap the size of bin/.cache somehow? I couldn't find anything in Splunk Admin manual.</P> Fri, 14 Oct 2016 18:06:13 GMT https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255049#M3167 arkadyz1 2016-10-14T18:06:13Z https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255050#M3168 <P>I realized that we are using httplib2 and are creating the connection with '.cache' parameter. I'm not completely sure it's the reason, though it may well be...</P> Mon, 17 Oct 2016 19:32:46 GMT https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255050#M3168 arkadyz1 2016-10-17T19:32:46Z https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255051#M3169 <P>OK, it's confirmed: I copy pasted some code from the Internet, getting an http connection like this:</P> <PRE><CODE>h = httplib2.Http(".cache", timeout = 10) </CODE></PRE> <P>(timeout was my addition). Once I removed that ".cache" from the parameters, the files stopped appearing there. A strange thing is: the cache was still populating even for requests with 'cache-control' header set to 'no-cache' (a bug in httplib2?)</P> <P>Consider this more of a "raising the awareness" post.</P> Mon, 17 Oct 2016 21:10:24 GMT https://community.splunk.com/t5/Splunk-Dev/Splunk-s-bin-cache-is-growing-out-of-proportions-Is-there-a/m-p/255051#M3169 arkadyz1 2016-10-17T21:10:24Z