topic Splunk parsing day of year incorrectly? in Splunk Enterprise

Splunk parsing day of year incorrectly?

arechenberg — Mon, 15 Aug 2016 17:31:54 GMT

Good day.

I am trying to import a CSV into Splunk and specifying a Timestamp format and it appears Splunk is not calculating the day of year properly.

My data has a column called 'Start Time' with values such as 222/06:00:00 I have specified the timestamp fields as Start Time and the Timestamp format as

%j/%H:%M:%S

Splunk correctly identifies the time but it assumes the day/date starts as today (08/15/2016) instead of the specified day of year in the imported data (e.g. 222 is actually 9 Aug. 2016).

I have tested this conversion by editing my CSV so that one of the rows has 001/06:05:04, which should parse to 01/01/2016 06:05:04.000 but instead parses to 08/15/2016 06:05:04.000

I've tried this data import on both Splunk Light Free (6.4.0) and Splunk Enterprise (6.4.2) and the results are the same.

Is this a problem with my data or with the way Splunk is parsing the day of year value?

Thanks,
Andy

Re: Splunk parsing day of year incorrectly?

sundareshr — Mon, 15 Aug 2016 17:55:38 GMT

You date format doesn't have a year value. Only has day of the year, which occurs every year. So splunk defaults to current date.

Re: Splunk parsing day of year incorrectly?

somesoni2 — Mon, 15 Aug 2016 18:15:29 GMT

The above format does work for me (splunk 6.2.6). Could you share the props.conf you're trying to user, for the sourcetype. (if using Splunk's add data from ui, go to advanced section on left and copy to clipboard).

Re: Splunk parsing day of year incorrectly?

lguinn2 — Tue, 16 Aug 2016 20:36:24 GMT

I believe that @sundareshr is correct:
"You [sic] date format doesn't have a year value. Only has day of the year, which occurs every year. So splunk defaults to current date."

The timestamp format must yield a complete and valid date. A partial date will not work. Here is How Timestamp Assignment Works. So you need to get the year into the date somewhere

Re: Splunk parsing day of year incorrectly?

arechenberg — Wed, 24 Aug 2016 15:17:40 GMT

Thanks for the reply Lisa. That was indeed the issue. I added the year in front as such:

  2016/231/06:00:00

Splunk then parsed the timestamp as expected.

Thanks again!