Splunk Search

maxresultrows not working for | search ... | stats count

rfujara_splunk
Splunk Employee
Splunk Employee

I'm the developer of the R Project app and currently working on issue #13.

When executing this...

index=_internal | r "output=data.frame(count=nrow(input))"

... it returns a count column with one row containing the number of events that are passed from the search (which is implicitly a search command) to the r command. But it's limited to the maxresultrows setting.

Based on what I see limits.conf documentation, that's the expected behaviour.

However, when executing this...

index=_internal | stats count

.. it returns the actual event count (which is not limited!), to me that's an unexpected behaviour.

Why is the number of search results not limited when passing piping the events to a stats command?

0 Karma
1 Solution

roryab
Splunk Employee
Splunk Employee

The stats command is a streaming command that uses map reduce to return the results of its calculations.

In the case of

index=_internal | stats count

only one actual result is returned - count

The search query may run against millions of actual events, but the events are not returned by the search, just the result.

The maxresults setting limits the number of results returned by the whole search, not the number of events it can scan.

View solution in original post

roryab
Splunk Employee
Splunk Employee

The stats command is a streaming command that uses map reduce to return the results of its calculations.

In the case of

index=_internal | stats count

only one actual result is returned - count

The search query may run against millions of actual events, but the events are not returned by the search, just the result.

The maxresults setting limits the number of results returned by the whole search, not the number of events it can scan.

Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...