Installation

Estimate Volume of Average Events Per Hour (in MB) for an Index/Sourcetype

SplunkDash
Motivator

Hello,

I can estimate the # of average events SPLUNK has for an index/sourcetype using following line of query /codes. How I would estimate the average Volume of data (in MB) SPLUNK receives per our for that index.  Thank you so much, appreciate your support.

Query to Estimate # of Ave Events per hour:

index=win_test sourcetype=* |bucket _time span=1h|stats count by _time|stats avg(count) as "Ave Events per Hour"

 

 

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

I believe the Monitoring Console has a dashboard panel that will provide that information.

If you want to do it yourself, try this variation of your query.

 

index=win_test sourcetype=* 
| bucket _time span=1h
| stats sum(eval(len(_raw))) as bytes by _time
| stats avg(bytes) as avgBytes
| eval avgMB=avgBytes/1024/1024
| rename avgMB as "Ave MB per Hour"

 

---
If this reply helps you, Karma would be appreciated.

View solution in original post

johnhuang
Motivator

index=_internal source=*metrics.log group=per_sourcetype_thruput earliest=-7d@d
| bucket _time span=1h
| stats sum(kb) AS size_kb BY _time series
| eval size_mb=size_kb/1024
| eval event_hour=strftime(_time, "%H:%M")
| rename series AS data_source
| chart limit=24 avg(size_mb) AS size_mb by data_source event_hour
| fillnull value="0.00"
| addtotals fieldname="hourly_avg"
| eval hourly_avg=ROUND(hourly_avg/24, 2)
| foreach *:* hourly_avg [| eval <<FIELD>>=ROUND('<<FIELD>>', 2)]

0 Karma

richgalloway
SplunkTrust
SplunkTrust

I believe the Monitoring Console has a dashboard panel that will provide that information.

If you want to do it yourself, try this variation of your query.

 

index=win_test sourcetype=* 
| bucket _time span=1h
| stats sum(eval(len(_raw))) as bytes by _time
| stats avg(bytes) as avgBytes
| eval avgMB=avgBytes/1024/1024
| rename avgMB as "Ave MB per Hour"

 

---
If this reply helps you, Karma would be appreciated.

tro
Path Finder

@richgalloway wrote:

I believe the Monitoring Console has a dashboard panel that will provide that information.

If you want to do it yourself, try this variation of your query.

 

index=win_test sourcetype=* 
| bucket _time span=1h
| stats sum(eval(len(_raw)) as bytes by _time
| stats avg(bytes) as avgBytes
| eval avgMB=avgBytes/1024/1024
| rename avgMB as "Ave MB per Hour"

 


You query contains mismatched parenthesis on `sum` line.

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Fixed.  Thanks for letting me know.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Enterprise Security Content Update (ESCU) | New Releases

In January, the Splunk Threat Research Team had one release of new security content via the Splunk ES Content ...

Expert Tips from Splunk Professional Services, Ensuring Compliance, and More New ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Observability Release Update: AI Assistant, AppD + Observability Cloud Integrations & ...

This month’s releases across the Splunk Observability portfolio deliver earlier detection and faster ...