Getting Data In

Chart indexed events per second over time

dslevy
Explorer

How can I use this to make a chart and graph over a 7 day period (for example) without running it in realtime? I want to be able to see the eps for a sourcetype so I can make an alert when a threshold is reached. I tried using:

index="_internal" (source=*metrics.log) group="per_sourcetype_thruput" series="cisco_asa" | timechart span=30m max(eps)

But this doesn't match up with another system I am using especially when a spike occurs.

Tags (2)

hexx
Splunk Employee
Splunk Employee

You cannot use metrics.log's "per_sourcetype_thruput" for this because it only samples the top 10 busiest source types for every capture period of 30s.

To accurately measure the rate of indexing of a given source type over time, you'd have to go to the events themselves and cursor your search using _indextime instead of _time, like so:

index=cisco sourcetype="cisco_asa"
| eval _time = _indextime
| bin _time span=30m
| stats count by _time
| timechart span=30m per_second(count) AS EPS
Get Updates on the Splunk Community!

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...