topic Re: Failed to parse timestamp in psv file in Getting Data In

Failed to parse timestamp in psv file

the_sigma — Fri, 12 Jul 2024 22:35:37 GMT

I have the following pipe separated value file that I am having problems onboarding. The first row is the column headers. Second row is sample data. I'm getting an error when attempting to use the CREA_TS column as the timestamps

07102024070808|INSERT|165713232|147994550|101394986|OLASFL

This is what I have for props but I cannot get it to identify the timestamp. Any help will be greatly appreciated.

[ psv ] CHARSET=UTF-8 FIELD_DELIMITER=| HEADER_FIELD_DELIMITER=| INDEXED_EXTRACTIONS=psv KV_MODE=none SHOULD_LINEMERGE=false category=Structured description=Pipe-separated value format. Set header and other settings in "Delimited Settings" disabled=false pulldown_type=true LINE_BREAKER=([\r\n]+) TIMESTAMP_FIELDS=CREA_TS TIME_PREFIX=^ MAX_TIMESTAMP_LOOKAHEAD=14

Re: Failed to parse timestamp in psv file

gcusello — Fri, 12 Jul 2024 06:46:03 GMT

Hi @the_sigma,

the props.conf seems to be ok, what's the issue you have?

the only thing is that I don't see the TIME_FORMAT field.

try saving a copy of your data in a text file and adding it using the Add data function: in this way you can test your extraction and eventual updates.

Ciao.

Giuseppe

Re: Failed to parse timestamp in psv file

manjunathmeti — Fri, 12 Jul 2024 09:06:48 GMT

Hi @the_sigma,

Try these configs:

[ psv ] CHARSET=UTF-8 INDEXED_EXTRACTIONS=PSV SHOULD_LINEMERGE=false category=Structured description=Pipe-separated value format. TIME_PREFIX=^ MAX_TIMESTAMP_LOOKAHEAD=14 TIME_FORMAT=%d%m%Y%H%M%S

Re: Failed to parse timestamp in psv file

ITWhisperer — Fri, 12 Jul 2024 09:25:31 GMT

I think the time format is more likely to be

TIME_FORMAT=%m%d%Y%H%M%S

Re: Failed to parse timestamp in psv file

the_sigma — Fri, 12 Jul 2024 19:36:51 GMT

It ended up being the time format was wrong. I had the month and day swapped. Thanks all for chiming in.