Splunk Search

Search auto-finalized after disk usage limit (100mb) reached - What does this mean?

simpkins1958
Contributor

Started getting Search auto-finalized after disk usage limit (100mb) reached - What does this mean?

Tags (1)
0 Karma

sandeepshah81
Explorer

Hi,

When we receive this message or warning saying 100MB threshold is reached, the output what we see, do we say whatever it has given with the search executed, is that accurate data??

Or this data cannot be considered as accurate because of 100MB threshold??

All, I wanted to understand is even with this 100MB threshold, the results which is given do we say it is accurate or it is partial and cannot be considred as Accurate enough and it needs to be optimised or run by a search admin with high disk quota to get accurate results...

Please advise

0 Karma

mayurr98
Super Champion

Hey

First,I think you need to optimise your search query
and secondly in search head $SPLUNK_HOME/etc/system/local/authorize.conf put

[your_role]
srchDiskQuota   = 500

Maximum amount of disk space (MB) that can be used by search jobs of a user that belongs to this role which is 500 MB by default its 100 MB
your_role is allowed to take up 500 megabytes total on disk for all their jobs.

refer this doc

http://docs.splunk.com/Documentation/Splunk/latest/Admin/authorizeconf#authorize.conf.example

I hope that helps you!

DalJeanis
SplunkTrust
SplunkTrust

Basically, you ran out of space.

The first thing you might consider doing is using the | fields command at the earliest point possible to eliminate everything but the fields you need. Other than that, you'd have to post a non-confidential version of the search to answers, in a separate question, and we could see how to help you make it more space-efficient.

somesoni2
SplunkTrust
SplunkTrust

You must be running a heavy search which , for it's processing, taking more than 100mb of dispatch directory and thus getting finalized. You should look at optimizing your search to reduce it's footprint (recommended) or adjust srchDiskQuota for your role in authorize.conf to increase the disk usage limit.

Get Updates on the Splunk Community!

What's new in Splunk Cloud Platform 9.1.2312?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.1.2312! Analysts can ...

What’s New in Splunk Security Essentials 3.8.0?

Splunk Security Essentials (SSE) is an app that can amplify the power of your existing Splunk Cloud Platform, ...

Let’s Get You Certified – Vegas-Style at .conf24

Are you ready to level up your Splunk game? Then, let’s get you certified live at .conf24 – our annual user ...