Getting Data In

"DateParserVerbose - Failed to parse timestamp" Error: Can TIME_FORMAT accept multiple formats?

sonicZ
Contributor

I am getting these errors, even though i think i have the timestamp parsed correctly based on other splunk answers.

2014 22:22:16.138 +0000 WARN  DateParserVerbose - Failed to parse timestamp. Defaulting to timestamp of previous event (Wed Oct 22 22:22:14 2014). Context: source::/app/logs/ocspresponder/ocspresponder.log|host::rat3be-d1-ap|ocsp_app|3549
10-22-2014 22:22:16.138 +0000 WARN  DateParserVerbose - Failed to parse timestamp. Defaulting to timestamp of previous event (Wed Oct 22 22:22:14 2014). Context: source::/app/logs/ocspresponder/ocspresponder.log|host::rat3be-d1-ap|ocsp_app|3549

Some sample data i am working with is as follows.

2014-10-21 22:01:07,348 [http-bio-8080-exec-1895] INFO  [c.s.s.o.c.OcspController]  GET IP: 24.222.89.103, 10.246.43.228, 72.246.43.217, 207.14.2.74  SN:  10c9cc  CA:  10923  SUCC  

Here's my props.conf that i am using

[ocsp_app]
MAX_TIMESTAMP_LOOKAHEAD = 24
SHOULD_LINEMERGE = false
TIME_FORMAT = %Y-%m-%d %H:%M:%S,%3N
TZ=UTC

I did notice sometimes data comes in with period or a comma for the milliseconds portion.
so

2014-10-21 22:01:07,348
 2014-10-21 22:01:07.348

Can TIME_FORMAT accept regexs?
This does not seem to work for me as i still get occasional DateParserVerbose errors with it enabled.

TIME_FORMAT = %Y-%m-%d %H:%M:%S(,|.)%3N

Also it seems like Splunk recognizes the timestamp by default using data preview but i still see the dateparserverbose errors on the ocsp_app sourcetype.

0 Karma

ShaneNewman
Motivator

I have also had the same problem. Using the information found here, I was able to figure it out 🙂

http://www.function1.com/2013/01/oh-no-splunking-log-files-with-multiple-formats-no-problem

0 Karma
Get Updates on the Splunk Community!

What’s New & Next in Splunk SOAR

Security teams today are dealing with more alerts, more tools, and more pressure than ever.  Join us on ...

Your Voice Matters! Help Us Shape the New Splunk Lantern Experience

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

September Community Champions: A Shoutout to Our Contributors!

As we close the books on another fantastic month, we want to take a moment to celebrate the people who are the ...