topic Re: Json parsing - Failed to parse timestamp in Getting Data In

Json parsing - Failed to parse timestamp

gobinspam — Tue, 29 Sep 2020 09:00:51 GMT

I'm trying to parse the following json input. I'm getting the data correctly indexed but I am also getting a warning.

WARN DateParserVerbose - Failed to parse timestamp. Defaulting to timestamp of previous event

{
  "events":[
    {
      "a":"057.00E09037A",
      "b":"cdw",
       "c":"1.2.7.7",
       "d":"192.168.1.0",
       "date":"2015-12-14T23:25:24.539Z"
    },
    {
      "a":"057.00E09037A",
      "b":"cdw",
       "c":"1.2.7.7",
       "d":"192.168.1.0",
       "date":"2015-12-14T23:25:24.542Z"
    }
  ]
}

Here is the configuration in my props.conf file:
[sample:events]
BREAK_ONLY_BEFORE = ({|[\s+{)
BREAK_ONLY_BEFORE_DATE = false
MUST_BREAK_AFTER = (}|}\s+])
NO_BINARY_CHECK = true
SEDCMD-remove_footer = s/]\s+}//g
SEDCMD-remove_header = s/({\s+.+?[)//g
SEDCMD-remove_trailing_commas = s/},/}/g
category = Custom
disabled = false
pulldown_type = true

Is there something in the props.conf file that I can do to avoid this warning.

Re: Json parsing - Failed to parse timestamp

somesoni2 — Mon, 07 Mar 2016 22:55:02 GMT

There are no timestamp recognition related configurations in your sourcetype. For better indexing performance, you should configure both event breaking and timestamp recognition configs in your sourcetype. Add following to your current props.conf under your sourcetype

TIME_PREFIX = date\":\"
TIME_FORMAT = %Y-%m-%dT%H:%M:%S.%N
MAX_TIMESTAMP_LOOKAHEAD = 23

Re: Json parsing - Failed to parse timestamp

gobinspam — Tue, 08 Mar 2016 01:40:19 GMT

Thanks @somesoni2

I have tried adding these fields. It still gives me the same warning.

Re: Json parsing - Failed to parse timestamp

somesoni2 — Tue, 08 Mar 2016 02:25:47 GMT

Just to be sure, this props.conf is on Indexer/Heavy forwarders.

Re: Json parsing - Failed to parse timestamp

gobinspam — Tue, 08 Mar 2016 02:48:53 GMT

Yes this is on the heavy forwarder. I have also tried manually loading the json content and applying the sourcetype configuration.