Splunk Enterprise
Highlighted

Why does my scheduled saved search randomly decide to return no results?

Builder

Hello!

I noticed that one of my scheduled saved searches randomly refuses to return results.  I can run the search at any point from the search bar and get data, even immediately after the scheduled saved search returns 0.  Here are the results of when it was scheduled at 2 and 5 minute intervals:

andrewtrobec_1-1593504439156.png

Randomly it will conclude with 0 results after a second with no errors.

Why would it do this?  How can I ensure that the results are produced consistently each time?

Thanks!

Andrew

Labels (1)
0 Karma
Highlighted

Re: Why does my scheduled saved search randomly decide to return no results?

Contributor

@andrewtrobec 

Did you check search.log for any errors?

0 Karma
Highlighted

Re: Why does my scheduled saved search randomly decide to return no results?

Builder

@anilchaithu 

Thanks for the reply.  The search.log logs do not contain any errors, but when I compare them for an execution that contains results (successful) vs. an execution that does not contain results (failed), I see the following differences:

  • successful execution sets user context before the following line, the failed execution sets it afterwards:

07-01-2020 06:00:07.397 INFO SearchParser - PARSING: | streamnoop

  • successful execution has the following line more than 150 times, the failed execution has it twice:

07-01-2020 05:50:04.890 INFO SearchEvaluator - using old evaluator

  • successful execution has the following line as the final line in the log, the failed execution does not:

07-01-2020 05:51:43.061 INFO PipelineComponent - Process delayed by 97.988 seconds, perhaps system was suspended?

Other than that they're pretty much the same.

Regards,

Andrew

0 Karma