Reporting

Data model split row 1M limit

hylam
Contributor

I am calculating the average number of page views per session in a web server log file. I have accelerated the data model. The 1M limit is smaller than expected for a big data map reduce technology. How does it scale up or scale out? I will consider sampling if this doesn't scale. Thx.

sourcetype=access_combined |stats count as cnt by session_id | stats avg(cnt)
(Note: I did not test this search)

alt text

0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

Data models scale with the regular horizontal scaling of Splunk, by adding more indexers.

0 Karma

hylam
Contributor

How does it scale up or scale out?

0 Karma
.conf21 CFS Extended through 5/20!

Don't miss your chance
to share your Splunk
wisdom in-person or
virtually at .conf21!

Call for Speakers has
been extended through
Thursday, 5/20!