Getting Data In

Index alert excessive growth

Emiskowi
New Member

We are having problem with some of our indexes growing rapidly. I am trying to figure out a search/alert that have a deviation by the hour compared to previous days at the same time. I have the following search below that gives me the usage by the hour. Any help would be greatly appreciated.

index=_internal group="per_index_thruput" earliest = -1h@h latest=@h
| eval mb=kb/1024
| timechart span=1h sum(mb) as HourlyTotal
| addtotals fieldname=HourlyTotal
| streamstats sum(HourlyTotal) AS AccumulatedTOTAL
| bucket _time span=1d

0 Karma

valiquet
Contributor

You can use standard deviation
| stats stdevp(HourlyTotal) as standdev by series | head 1 | where Hourly> HourlyTotal*2

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

How to Break a Kubernetes Pod on Purpose and Let the AI Troubleshooting Agent Find ...

Let's say I've just rolled out a Kubernetes Deployment with a typo in the image tag. Nothing explodes. The pod ...

Splunk Add-on for Microsoft Windows 11.0.3: Parse Once, Search Faster

The updated Splunk Add-on for Microsoft Windows helps customers search Windows events faster by reducing ...

What's New in Splunk Enterprise Security 8.8 and Beyond

Threats move at machine speed. Keeping up should not depend on having the biggest budget, the largest team, or ...