<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Durable Search does not refill the data in Reporting</title>
    <link>https://community.splunk.com/t5/Reporting/Durable-Search-does-not-refill-the-data/m-p/590595#M11292</link>
    <description>&lt;P&gt;Hello,&amp;nbsp;&lt;/P&gt;&lt;P&gt;I have a scheduled report, which is used to fill a summary index.&amp;nbsp;&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;The report for the summary index is scheduled &lt;STRONG&gt;hourly (based on indextime)&lt;/STRONG&gt;&lt;/LI&gt;&lt;LI&gt;The event data is usually &lt;STRONG&gt;indexed on daily basis&lt;/STRONG&gt; at once (sometimes though there are multiple data ingestions of the server per day)&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;Now the thing is, that the search is inefficient. In normal cases, this is no issue, but when a day was skipped for ingestion and the next day therefore indexes two days of event data at once, the report for the summary index will crash and there will be a gap in the summary index.&lt;/P&gt;&lt;P&gt;To avoid data gaps, I configured the search to be &lt;A href="https://docs.splunk.com/Documentation/Splunk/8.2.3/Report/Durablesearch?ref=hk#Set_up_durable_search_for_a_summary_index" target="_self"&gt;durable&lt;/A&gt;&lt;/P&gt;&lt;P&gt;This is the configuration regarding the time constraints of the search:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="blablabla_0-1648106475925.png" style="width: 400px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/18735i5A8FFE8E884C01A9/image-size/medium?v=v2&amp;amp;px=400" role="button" title="blablabla_0-1648106475925.png" alt="blablabla_0-1648106475925.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;This is the configuration for the durable search (Backfill method is multiple, as it is recommended for searches with transforming commands)&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="blablabla_2-1648106629673.png" style="width: 400px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/18737iFFA767DC4089A535/image-size/medium?v=v2&amp;amp;px=400" role="button" title="blablabla_2-1648106629673.png" alt="blablabla_2-1648106629673.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;To test, if data gaps of the summary index are recovered automatically, I stopped the dataflow of for the event index for 5 days and then indexed all the data at once, knowing, that this will lead the scheduled report to crash.&lt;/P&gt;&lt;P&gt;Unfortunately, the durable search did not recover the data gap of the summary index. From the 5 days only a few hours were indexed into the summary index. Does someone have an idea why this is so?&lt;/P&gt;&lt;P&gt;Thanks and best regards&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Thu, 24 Mar 2022 07:28:37 GMT</pubDate>
    <dc:creator>blablabla</dc:creator>
    <dc:date>2022-03-24T07:28:37Z</dc:date>
    <item>
      <title>Durable Search does not refill the data</title>
      <link>https://community.splunk.com/t5/Reporting/Durable-Search-does-not-refill-the-data/m-p/590595#M11292</link>
      <description>&lt;P&gt;Hello,&amp;nbsp;&lt;/P&gt;&lt;P&gt;I have a scheduled report, which is used to fill a summary index.&amp;nbsp;&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;The report for the summary index is scheduled &lt;STRONG&gt;hourly (based on indextime)&lt;/STRONG&gt;&lt;/LI&gt;&lt;LI&gt;The event data is usually &lt;STRONG&gt;indexed on daily basis&lt;/STRONG&gt; at once (sometimes though there are multiple data ingestions of the server per day)&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;Now the thing is, that the search is inefficient. In normal cases, this is no issue, but when a day was skipped for ingestion and the next day therefore indexes two days of event data at once, the report for the summary index will crash and there will be a gap in the summary index.&lt;/P&gt;&lt;P&gt;To avoid data gaps, I configured the search to be &lt;A href="https://docs.splunk.com/Documentation/Splunk/8.2.3/Report/Durablesearch?ref=hk#Set_up_durable_search_for_a_summary_index" target="_self"&gt;durable&lt;/A&gt;&lt;/P&gt;&lt;P&gt;This is the configuration regarding the time constraints of the search:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="blablabla_0-1648106475925.png" style="width: 400px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/18735i5A8FFE8E884C01A9/image-size/medium?v=v2&amp;amp;px=400" role="button" title="blablabla_0-1648106475925.png" alt="blablabla_0-1648106475925.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;This is the configuration for the durable search (Backfill method is multiple, as it is recommended for searches with transforming commands)&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="blablabla_2-1648106629673.png" style="width: 400px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/18737iFFA767DC4089A535/image-size/medium?v=v2&amp;amp;px=400" role="button" title="blablabla_2-1648106629673.png" alt="blablabla_2-1648106629673.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;To test, if data gaps of the summary index are recovered automatically, I stopped the dataflow of for the event index for 5 days and then indexed all the data at once, knowing, that this will lead the scheduled report to crash.&lt;/P&gt;&lt;P&gt;Unfortunately, the durable search did not recover the data gap of the summary index. From the 5 days only a few hours were indexed into the summary index. Does someone have an idea why this is so?&lt;/P&gt;&lt;P&gt;Thanks and best regards&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Thu, 24 Mar 2022 07:28:37 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Reporting/Durable-Search-does-not-refill-the-data/m-p/590595#M11292</guid>
      <dc:creator>blablabla</dc:creator>
      <dc:date>2022-03-24T07:28:37Z</dc:date>
    </item>
  </channel>
</rss>

