https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220140#M43235 <P>How does the directory structure look under /mapr/tmp/dispatch? Each search job should have its own directory...</P> Sat, 27 Feb 2016 00:49:55 GMT ddrillic 2016-02-27T00:49:55Z https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220137#M43232 <P>We are using Hunk with MapR. There is a dispatch directory that Hunk uses for the reduce of the map reduce. <CODE>/mapr/tmp/dispatch</CODE>. </P> <P>We are seeing files deleted from this directory while the search is progressing: First the heartbeat file, and then the sub directories. <BR /> The search has not completed and this hangs the search job forever. </P> <P>Is this part of Hunk to delete these files as they age? If so, what is the delete age and or setting to control it? </P> <P>We are also seeing any non hunk file being deleted from this directory. Is Hunk deleting them? </P> Tue, 23 Feb 2016 22:33:40 GMT https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220137#M43232 splunkIT 2016-02-23T22:33:40Z https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220138#M43233 <P>Overall – yes this is expected. Hunk deletes the files under the Hunk HDFS working directory.<BR /> What is not expected, is that it will delete these files before the job is completed and these files are still needed</P> Thu, 25 Feb 2016 15:30:12 GMT https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220138#M43233 rdagan_splunk 2016-02-25T15:30:12Z https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220139#M43234 <P>Do you have two instances of Hunk pointing to the same Hunk working directory in HDFS?</P> Fri, 26 Feb 2016 22:44:08 GMT https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220139#M43234 rdagan_splunk 2016-02-26T22:44:08Z https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220140#M43235 <P>How does the directory structure look under /mapr/tmp/dispatch? Each search job should have its own directory...</P> Sat, 27 Feb 2016 00:49:55 GMT https://community.splunk.com/t5/Getting-Data-In/Is-it-expected-behavior-for-Hunk-to-delete-files-as-they-age/m-p/220140#M43235 ddrillic 2016-02-27T00:49:55Z