Reporting

Data model split row 1M limit

hylam
Contributor

I am calculating the average number of page views per session in a web server log file. I have accelerated the data model. The 1M limit is smaller than expected for a big data map reduce technology. How does it scale up or scale out? I will consider sampling if this doesn't scale. Thx.

sourcetype=access_combined |stats count as cnt by session_id | stats avg(cnt)
(Note: I did not test this search)

alt text

0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

A zero usually tells Splunk to not apply any limit.

martin_mueller
SplunkTrust
SplunkTrust

Data models scale with the regular horizontal scaling of Splunk, by adding more indexers.

0 Karma

hylam
Contributor

How does it scale up or scale out?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...