Suppose I have a summary index storing summarized minute-ly data populated from sistats. Suppose each minute contains 1 million records worth of data that was summarized into 10,000 records, representing that minute. Now, I want a report showing average values for 1 week. I am running a stats search on the summary index, but it is taking forever. However If I build multiple layers of sistats, I get the results in a more timely manner. For example, sistats for 1 min, store in summary index along with custom field reportName=minute. Then sistats on "minute" report for last 60 mins into summary index along with custom field reportName=hourly. Then do the same for daily, and, finally, weekly levels. Each step takes less than 1 min.
What do I lose by layering sistats in this way? Would the final weekly report be accurate and reap sistats benefits, or would it have the same effect as layering regular stats results together? This method is more performant, but I am unsure if it is as accurate as sistat'ing once, then running stats on the summary index over the whole week (even if it does take ages).
... View more