Monitoring Splunk

Resource impact when extending search job lifetime

ahmadkhilfi
Engager

Hi,

I'm still new to Splunk and I understand that I can extend search or report lifecycle either using GUI or change the dispatch.ttl when scheduling a report. I want to know what will happen when I have hundreds of searches and reports with extended lifetime (7days or more), will there be any impact to the hardware resources when Splunk holds so much data for these reports and searches?

 

Labels (2)
Tags (3)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

The search results will be retained on the search head for 7+ days.  That means disk space will be consumed and not released until the search expires.  The role's disk quota also will be consumed, which may prevent future searches from running.

---
If this reply helps you, Karma would be appreciated.

ahmadkhilfi
Engager

That makes sense, so is there any query or any way to find out how many MBs these search results are consuming on disk?

0 Karma

PickleRick
SplunkTrust
SplunkTrust

There is no direct REST endpoint to query for the current state of quota consumption.

You might be able to dig out something from the _introspection or _metrics indexes but I wouldn't count on too much granularity.

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Probably you need to your own TA/scripted input to looking used disk space on $SPLUNK_HOME/var/splunk/dispatch directory?

0 Karma
Get Updates on the Splunk Community!

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...

Adoption of Infrastructure Monitoring at Splunk

  Splunk's Growth Engineering team showcases one of their first Splunk product adoption-Splunk Infrastructure ...

Modern way of developing distributed application using OTel

Recently, I had the opportunity to work on a complex microservice using Spring boot and Quarkus to develop a ...