topic Re: TIME_FORMAT and subseconds in Getting Data In

What is the strptime-style %-variable that TIME_FORMAT would use for subseconds?

dwaddle — Mon, 16 Jan 2023 19:40:16 GMT

What is the strptime-style %-variable that TIME_FORMAT would use for subseconds? The docs for props.conf suggest the strptime manpage, but being a time_t (which has only second-level precision) there's no such information there.

Re: TIME_FORMAT and subseconds

gkanapathy — Thu, 29 Apr 2010 02:54:30 GMT

2008-04-25 12:34:56.689 -> %Y-%m-%d %H:%M:%S.%3N

12:34:56,789012 -> %H:%M:%S,%6N

http://www.splunk.com/base/Documentation/latest/Admin/Configuretimestamprecognition#Enhanced_strptime.28.29_support

Re: TIME_FORMAT and subseconds

jrodman — Thu, 29 Apr 2010 14:46:58 GMT

To add detail to gkapanthy's answer, the %3N means you have 3 digits of subseconds (milliseconds) while %6N is microseconds. You could use %9N for nanoseconds (dtrace uses this granularity, for example).

We used system strptime at one point, nowadays we have our own implementation which supports a number of common extensions. All the subsecond conversion strings are equivalent if you specify the number of digits.

Note that our internal datastructures still store the data by the second, which means if you have very very large numbers of events in the same second (eg. hundreds of thousands), there can be some performance issues when having to sort them.

EDIT: matteo points out the bit about _time not containing subseconds was incorrect.

Re: TIME_FORMAT and subseconds

jkat54 — Fri, 13 Jan 2023 20:55:35 GMT

For short:
YYYY-MM-DD = %F
HH:MM:SS = %T

Ex.
TIME_FORMAT=%F %T,%3N