Dashboards & Visualizations

"These results may be truncated. Your search generated too much data for the current visualization configuration."

akanno
Communicator

Hi, splunk community.

I get following message in panel.

"These results may be truncated. Your search generated too much data for the current visualization configuration."

I have bothered that the results is truncated.

then I tried to use flash chart.

It's because if you need to display a large number of axis categories, use FlashChart, in below manual

http://docs.splunk.com/Documentation/Splunk/6.1.4/AdvancedDev/CustomChartingConfig-JSChart

and so I set in web.conf

simple_xml_force_flash_charting = true

However,the results is truncated.

Is there a way to solve?

1 Solution

sansay
Contributor

Truncation will always happen if your query generates more points than FlashChart can handle. Per the document you are referring to, the maximum number of points it can handle is 2000.
All you need to do is reduce the resolution of your chart. For example, if you have a chart that returns a single line data points for 2 days, a "span=1m" will result in 1440 min/day * 2 = 2880 points.
In that case, use "span=5m", and you will get 2880/5 = 576 points, and you will not get your data truncated.

Like I said in my answer to your comments, you will have to use FlashChart in advanced XML.
Here is a quickly put together test dashboard which doesn't truncate the results of your query.

<view autoCancelInterval="90" isVisible="true"  objectMode="SimpleDashboard" onunloadCancelJobs="true" refresh="-1" template="dashboard.html">
  <label>TEST</label>
  <module name="AccountBar" layoutPanel="appHeader"/>
  <module name="AppBar" layoutPanel="navigationHeader"/>
  <module name="Message" layoutPanel="messaging">
    <param name="maxSize">1</param>
    <param name="clearOnJobDispatch">False</param>
    <param name="filter">*</param>
  </module>
  <module name="DashboardTitleBar" layoutPanel="viewHeader"/>    
  <module name="Message" layoutPanel="navigationHeader">
    <param name="level">warn</param>
    <param name="maxSize">1</param>
    <param name="clearOnJobDispatch">True</param>
    <param name="filter">splunk.search.job</param>
  </module>
  <module name="HiddenSearch" layoutPanel="panel_row1_col1" group="test" autoRun="True">
    <param name="groupLabel">test</param>
    <param name="search">earliest=-60m index=_internal | timechart span=1m count by component useother=f limit=0</param>
    <module name="ViewstateAdapter">
      <module name="HiddenFieldPicker">
        <param name="strictMode">True</param>
        <module name="JobProgressIndicator">
          <module name="EnablePreview">
            <param name="display">False</param>
            <param name="enable">True</param>
            <module name="HiddenChartFormatter">
              <param name="charting.chart">line</param>    
              <param name="charting.axisTitleX.text"></param>                              
              <param name="charting.legend.placement">top</param>
              <module name="FlashChart">
                <param name="width">100%</param>
                <module name="ConvertToDrilldownSearch">
                  <module name="ViewRedirector">
                    <param name="viewTarget">flashtimeline</param>
                  </module>
                </module>
              </module>
              <module name="ViewRedirectorLink">
                <param name="viewTarget">flashtimeline</param>
              </module>
            </module>
          </module>
        </module>
      </module>
    </module>
  </module>
</view>

View solution in original post

sansay
Contributor

Truncation will always happen if your query generates more points than FlashChart can handle. Per the document you are referring to, the maximum number of points it can handle is 2000.
All you need to do is reduce the resolution of your chart. For example, if you have a chart that returns a single line data points for 2 days, a "span=1m" will result in 1440 min/day * 2 = 2880 points.
In that case, use "span=5m", and you will get 2880/5 = 576 points, and you will not get your data truncated.

Like I said in my answer to your comments, you will have to use FlashChart in advanced XML.
Here is a quickly put together test dashboard which doesn't truncate the results of your query.

<view autoCancelInterval="90" isVisible="true"  objectMode="SimpleDashboard" onunloadCancelJobs="true" refresh="-1" template="dashboard.html">
  <label>TEST</label>
  <module name="AccountBar" layoutPanel="appHeader"/>
  <module name="AppBar" layoutPanel="navigationHeader"/>
  <module name="Message" layoutPanel="messaging">
    <param name="maxSize">1</param>
    <param name="clearOnJobDispatch">False</param>
    <param name="filter">*</param>
  </module>
  <module name="DashboardTitleBar" layoutPanel="viewHeader"/>    
  <module name="Message" layoutPanel="navigationHeader">
    <param name="level">warn</param>
    <param name="maxSize">1</param>
    <param name="clearOnJobDispatch">True</param>
    <param name="filter">splunk.search.job</param>
  </module>
  <module name="HiddenSearch" layoutPanel="panel_row1_col1" group="test" autoRun="True">
    <param name="groupLabel">test</param>
    <param name="search">earliest=-60m index=_internal | timechart span=1m count by component useother=f limit=0</param>
    <module name="ViewstateAdapter">
      <module name="HiddenFieldPicker">
        <param name="strictMode">True</param>
        <module name="JobProgressIndicator">
          <module name="EnablePreview">
            <param name="display">False</param>
            <param name="enable">True</param>
            <module name="HiddenChartFormatter">
              <param name="charting.chart">line</param>    
              <param name="charting.axisTitleX.text"></param>                              
              <param name="charting.legend.placement">top</param>
              <module name="FlashChart">
                <param name="width">100%</param>
                <module name="ConvertToDrilldownSearch">
                  <module name="ViewRedirector">
                    <param name="viewTarget">flashtimeline</param>
                  </module>
                </module>
              </module>
              <module name="ViewRedirectorLink">
                <param name="viewTarget">flashtimeline</param>
              </module>
            </module>
          </module>
        </module>
      </module>
    </module>
  </module>
</view>

akanno
Communicator

I understand that I can not use FlashChart unless I use Advanced XML.

Thank you very much.

0 Karma

akanno
Communicator

index=_internal | timechart span=10m count by component useother=f limit=0

please try this command at last 60 min.

I seem that this command is about 62 line * 60min/10min = 372 points

However I got the message that "These results may be truncated. Your search generated too much data for the current visualization configuration."

0 Karma

sansay
Contributor

Ah sorry but I didn't realize this little detail:
" Simple XML does not support Flash charts. A Flash chart referenced in simple XML does not display."
which I found in this doc:
http://docs.splunk.com/Documentation/Splunk/6.1.3/AdvancedDev/CustomChartingConfig-JSChart

This contradicts the possibility of the "simple_xml_force_flash_charting" setting being effective.

Anyway, running your query in the search app (which uses JSChart) did truncate. This query returns 60 series.But I also found the following:
1. increasing the time span didn't help at all, even if set to 30 minutes.
2. decreasing the number of series down to 47 stopped the truncation, even with the span set to 1 minute.
This tells us that there is a hard limit set in the JSChart.conf. Then I searched some more and found this: " JSChart can only plot the first 50 series that are returned.
Additional series are not plotted. "
I think there are just too many limits in JSChart.
I would highly recommend that you go to Advanced XML. This way you can tell it to use FlashChart.

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Level Up Your .conf25: Splunk Arcade Comes to Boston

With .conf25 right around the corner in Boston, there’s a lot to look forward to — inspiring keynotes, ...

Manual Instrumentation with Splunk Observability Cloud: How to Instrument Frontend ...

Although it might seem daunting, as we’ve seen in this series, manual instrumentation can be straightforward ...

Take Action Automatically on Splunk Alerts with Red Hat Ansible Automation Platform

Ready to make your IT operations smarter and more efficient? Discover how to automate Splunk alerts with Red ...