<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Why is coldPath.maxDataSizeMB taking precedence and growing until parameter is reached? in Getting Data In</title>
    <link>https://community.splunk.com/t5/Getting-Data-In/Why-is-coldPath-maxDataSizeMB-taking-precedence-and-growing/m-p/492313#M84144</link>
    <description>&lt;P&gt;I have the following configuration for an index extracted by using btool:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;/opt/splunk/etc/system/local/indexes.conf   coldPath.maxDataSizeMB = 1843200
/opt/splunk/etc/system/local/indexes.conf   maxTotalDataSizeMB = 500000
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;But the coldPath doesn't care about &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt; parameter and it gets bigger and bigger:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;950G    ./colddb
36G     ./frozendb
74M     ./datamodel_summary
4.0K    ./thaweddb
985G    .
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;So I checked how other indexes in my production environment were configured. For other indexes, I have the following configuration:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;/opt/splunk/etc/system/local/indexes.conf   coldPath.maxDataSizeMB = 0
/opt/splunk/etc/system/local/indexes.conf   maxTotalDataSizeMB = 500000
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;And for these cases the rotation works propertly.&lt;/P&gt;

&lt;P&gt;So my opinion is that &lt;STRONG&gt;coldPath.maxDataSizeMB&lt;/STRONG&gt; has precedence over &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt; and even when &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt;  is reached it keeps growing until &lt;STRONG&gt;coldPath.maxDataSizeMB&lt;/STRONG&gt; parameter is reached.&lt;/P&gt;

&lt;P&gt;I hope someone can help me to understand this situation because I'm suffering a huge problem in my environment.&lt;/P&gt;

&lt;P&gt;Thank you in advance.&lt;/P&gt;</description>
    <pubDate>Thu, 21 Nov 2019 16:47:06 GMT</pubDate>
    <dc:creator>srteclesmayer</dc:creator>
    <dc:date>2019-11-21T16:47:06Z</dc:date>
    <item>
      <title>Why is coldPath.maxDataSizeMB taking precedence and growing until parameter is reached?</title>
      <link>https://community.splunk.com/t5/Getting-Data-In/Why-is-coldPath-maxDataSizeMB-taking-precedence-and-growing/m-p/492313#M84144</link>
      <description>&lt;P&gt;I have the following configuration for an index extracted by using btool:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;/opt/splunk/etc/system/local/indexes.conf   coldPath.maxDataSizeMB = 1843200
/opt/splunk/etc/system/local/indexes.conf   maxTotalDataSizeMB = 500000
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;But the coldPath doesn't care about &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt; parameter and it gets bigger and bigger:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;950G    ./colddb
36G     ./frozendb
74M     ./datamodel_summary
4.0K    ./thaweddb
985G    .
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;So I checked how other indexes in my production environment were configured. For other indexes, I have the following configuration:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;/opt/splunk/etc/system/local/indexes.conf   coldPath.maxDataSizeMB = 0
/opt/splunk/etc/system/local/indexes.conf   maxTotalDataSizeMB = 500000
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;And for these cases the rotation works propertly.&lt;/P&gt;

&lt;P&gt;So my opinion is that &lt;STRONG&gt;coldPath.maxDataSizeMB&lt;/STRONG&gt; has precedence over &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt; and even when &lt;STRONG&gt;maxTotalDataSizeMB&lt;/STRONG&gt;  is reached it keeps growing until &lt;STRONG&gt;coldPath.maxDataSizeMB&lt;/STRONG&gt; parameter is reached.&lt;/P&gt;

&lt;P&gt;I hope someone can help me to understand this situation because I'm suffering a huge problem in my environment.&lt;/P&gt;

&lt;P&gt;Thank you in advance.&lt;/P&gt;</description>
      <pubDate>Thu, 21 Nov 2019 16:47:06 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Getting-Data-In/Why-is-coldPath-maxDataSizeMB-taking-precedence-and-growing/m-p/492313#M84144</guid>
      <dc:creator>srteclesmayer</dc:creator>
      <dc:date>2019-11-21T16:47:06Z</dc:date>
    </item>
  </channel>
</rss>

