topic Re: display start and endtime in results in Splunk Search

display start and endtime in results

dtakacssplunk — Mon, 02 Jul 2018 08:00:47 GMT

I would like to write a query which will start with starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:01:00 index=* ... and then take starttime and endtime as parameters... and create an epoch time in the result.

basically every 1 minute I plan to execute

starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:01:00  index=* ...
starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:02:00  index=* ...
starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:03:00  index=* ...
...

and I want to get something as a table like

1533686460,1
1533686520,1
1533686580,1
...

thanks

Re: display start and endtime in results

renjith_nair — Mon, 02 Jul 2018 12:52:50 GMT

Hi @dtakacssplunk,

You could either use eval starttime=strptime(starttime,"%m/%d/%Y:%H:%M:%S") or just eval start_time=starttime to get the epoch. Similarly for endtime

Re: display start and endtime in results

dtakacssplunk — Tue, 29 Sep 2020 20:15:20 GMT

I have tried both but 0 events get returned from either:

starttime=07/01/2018:00:00:00 endtime=07/01/2018:00:01:00 eval start_time=starttime | table start_time

starttime=07/01/2018:00:00:00 endtime=07/01/2018:00:01:00 eval start_time=strptime(starttime,"%m/%d/%Y:%H:%M:%S") | table start_time

I'm using splunk 6.5

Re: display start and endtime in results

renjith_nair — Tue, 03 Jul 2018 02:21:10 GMT

Are you getting events for your existing search ie.starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:01:00 index=. Can you post a sample event result?

Re: display start and endtime in results

dtakacssplunk — Tue, 03 Jul 2018 03:34:17 GMT

yes definitely I do get results for:
starttime=06/08/2018:00:00:00 endtime=06/08/2018:00:01:00 index=*
(put * after index)

I cannot post a sample event result.

Do the queries I put above work for your splunk instance?

Re: display start and endtime in results

renjith_nair — Tue, 03 Jul 2018 05:01:28 GMT

I dont have events for these dates but the below dummy search works for me .

|makeresults|eval starttime="06/08/2018:00:00:00" |eval endtime="06/08/2018:00:01:00"|eval start_time=strptime(starttime,"%m/%d/%Y:%H:%M:%S")

Re: display start and endtime in results

woodcock — Mon, 16 Jul 2018 00:41:21 GMT

Why would you run a search every minute to look for the last minute? This would be both very wasteful and does not account for forwarding pipeline latency (a typical average latency from when the event happened to when it gets indexed is ~250 seconds, which is longer than 60 seconds). Let's back up and tell us what data you have (SHOW SAMPLE EVENTS) and explain what you are trying to achieve (forget about SPL for now).

Re: display start and endtime in results

dtakacssplunk — Thu, 02 Aug 2018 13:49:12 GMT

my intention is to copy events out of splunk into some other store. I would like to periodically run a query and copy the splunk data somewhere else.

certain cases the splunk instance is down / times out queries / events show up later then indexing time...

usually i could have gotten let's say every hour results and appended to the exported dataset the results. but I do want to upsert. in the upsert key I want to use the starttime

anyways seems like starttime / endtime are very special parameters which cannot be used in the table being created