topic Query running time in Splunk Search

Query running time

Kwip — Wed, 27 Dec 2017 16:56:04 GMT

I want to run a query every 5 minutes starting from today 7 AM to next day 5 AM and so on. Throughout my run earliest time should be 7 AM today and latest can be now.

I tried several combinations but everything messed up when running over the mid noght. after the 12 00 AM the earliest is becoming invalid. All of the below methods taking earliest time as 7 AM till end of the day. when running after the mid night throwing error saying earliest time should not be greater than latest time.

Try 1
| makeresults | eval starttime=strptime(strftime(now(),"%d/%m/%Y 07:00:00 AM"),"%d/%m/%Y %I:%M:%S %p") , endtime=starttime+7920

Try 2
earliest=@d+7h

Try 3
     | eval now=now() 
     | eval earliest=relative_time(now, "@d+1d+7h") 
     | eval earliest=if((earliest<now), earliest, relative_time(now, "@d+7h")) 
     | eval search = "earliest=" . earliest
     | table search]

Re: Query running time

somesoni2 — Wed, 27 Dec 2017 17:08:48 GMT

Try like this

your base search [| makeresults | eval earliest=if(now()<=relative_time(now(),"@d+5h"),"-1d@d+7h","@d+7h") | eval latest="now" | table earliest latest ]

Re: Query running time

micahkemp — Wed, 27 Dec 2017 17:20:13 GMT

Try something like this:

<your base search>
[| makeresults 
| addinfo 
| eval latest=now() 
| eval today_7_am=relative_time(latest, "@d+7h") 
| eval yesterday_7_am=relative_time(latest, "-1d@d+7h") 
| eval earliest=if(today_7_am<latest, today_7_am, yesterday_7_am) 
| table earliest]

That does a simple comparison of your calculated earliest times to determine which was actually in the past, and chooses that one.

Re: Query running time

micahkemp — Wed, 27 Dec 2017 18:30:43 GMT

This seems to be a duplicate.

Re: Query running time

nawazns5038 — Wed, 27 Dec 2017 22:55:43 GMT

index=_internal [| makeresults | eval earliest=if(now()<=relative_time(now(),"@d+5h"),"-1d@d+7h","@d+7h") | eval latest="now" | table earliest latest ]

I tried it and it gave me an error "Error in 'search' command: Unable to parse the search: 'AND' operator is missing a clause on the left hand side."

How to create new earliest and latest time fields and use them in query

Re: Query running time

Kwip — Thu, 28 Dec 2017 01:23:44 GMT

Verifying this query. Working fine now. Will verify over mid night window and let you know the outcome.

Re: Query running time

Kwip — Thu, 28 Dec 2017 01:29:06 GMT

Verifying this query. Working fine now. Will verify over mid night window and let you know the outcome.

Re: Query running time

Kwip — Thu, 28 Dec 2017 06:15:53 GMT

@ somesoni2,
Wow!! Thank you very much It is working fine!

Re: Query running time

Kwip — Thu, 28 Dec 2017 06:16:30 GMT

@ micahkemp,
Wow!! Thank you very much It is working fine!

Re: Query running time

nawazns5038 — Thu, 28 Dec 2017 22:00:46 GMT

How did you verify ?

How did you use the earliest and latest time fields created by the query into _time of Splunk.

Re: Query running time

Kwip — Fri, 29 Dec 2017 01:28:48 GMT

@nawazns5038
You no need anything else apart from adding the particular portion in the query.

your base search 
[| makeresults 
| eval earliest=if(now()<=relative_time(now(),"@d+5h"),"-1d@d+7h","@d+7h") 
| eval latest="now" 
| table earliest latest ]
| stats/eval/table/or whatever operation you want to perform.

While running this query, running span will be automatically taken from this query.

Re: Query running time

Kwip — Thu, 02 Aug 2018 21:04:22 GMT

@somesoni2
I am getting below error while using this query after the splunk upgrade to 7.0. Any thoughts?

Error in 'search' command: Unable to parse the search: 'AND' operator is missing a clause on the left hand side.

Re: Query running time

somesoni2 — Thu, 02 Aug 2018 23:17:09 GMT

Try this

your base search 
 [| makeresults 
 | eval earliest=if(now()<=relative_time(now(),"@d+5h"),"-1d@d+7h","@d+7h") 
 | eval latest="now" 
 | table earliest latest | format ]
 | stats/eval/table/or whatever operation you want to perform.

your base search 
 [| makeresults 
 | eval earliest=if(now()<=relative_time(now(),"@d+5h"),"-1d@d+7h","@d+7h") 
 | eval latest="now" 
 | table earliest latest  | format "" "" "" "" "" ""]
 | stats/eval/table/or whatever operation you want to perform.

Re: Query running time

Kwip — Fri, 03 Aug 2018 18:08:52 GMT

Thank you @somesoni2, It is working fine.