Reporting

Data model split row 1M limit

hylam
Contributor

I am calculating the average number of page views per session in a web server log file. I have accelerated the data model. The 1M limit is smaller than expected for a big data map reduce technology. How does it scale up or scale out? I will consider sampling if this doesn't scale. Thx.

sourcetype=access_combined |stats count as cnt by session_id | stats avg(cnt)
(Note: I did not test this search)

alt text

0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

Data models scale with the regular horizontal scaling of Splunk, by adding more indexers.

0 Karma

hylam
Contributor

How does it scale up or scale out?

0 Karma
.conf21 Now Fully Virtual!
Register for FREE Today!

We've made .conf21 totally virtual and totally FREE! Our completely online experience will run from 10/19 through 10/20 with some additional events, too!