Reporting

What is the difference between indexed real-time vs scheduled search every minute for the previous minute?

ndavis4
Explorer

I understand that indexed real-time searches are not up to the second and lag (default of 60 sec) behind a real-time search. With this being the case, what is the difference between these two searches?

Scheduled search:
savesearches.conf
cron_schedule = * * * * *
dispatch.earliest_time = -1m
dispatch.latest_time = now

AND

Indexed real-time search **
**limits.conf

indexed_realtime_disk_sync_delay = 60

valiquet
Contributor

Realtime takes much more ressources and I disable it by default. Ad-hoc search let your search into the stored data in the index tier. Realtime search send you the events before storing them. He have around 150 servers for Splunk at 40 000$ each and we still a reluctant to give that capability since we prefer to waste our CPU elsewhere.

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

One key difference is that your scheduled search will inevitably miss events. A practical example:

23:45:59 event happens
23:46:00 search 1 runs for 23:45-23:46
23:46:01 event is indexed
23:47:00 search 2 runs for 23:46-23:47

Search 1 doesn't have the event yet, search 2 doesn't care about the event any more.
If you know your delays you could build them into your time range, or even better run on indexed time for your main interval timerange.

koshyk
Super Champion

great example. thanks again @martin_mueller

0 Karma
Get Updates on the Splunk Community!

.conf24 | Day 0

Hello Splunk Community! My name is Chris, and I'm based in Canberra, Australia's capital, and I travelled for ...

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

 (view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...