Getting Data In

How to configure timestamp to recognize multiline timestamp?

iljubicic
Engager

I am a new Splunk user and I am having difficulties resolving this problem. I have an xml log file as an input structured like this:

<LOG>
 <DATE>DDMMYYYY</DATE>
 <TIME>HHMMSS</TIME>
 <CC>\d{16}</CC>
 <AMOUNT>\d+\.\d{2}</AMOUNT>
</LOG>

where logs are separated with LOG tag. What do I need to do to make Splunk to correctly read the timestamp that is separated in the two lines (DATE and TIME)?

1 Solution

maciep
Champion

You'll need to configure props.conf at the parsing layer (probably on your indexer) appropriately. That includes creating a new stanza for your sourcetype and telling Splunk how to deal with the format.

http://docs.splunk.com/Documentation/Splunk/latest/admin/Propsconf

http://pubs.opengroup.org/onlinepubs/009695399/functions/strptime.html

Something like this should work. Tell splunk to merge multiple lines into one event and where to break events. Then tell it where the timestamp is and what the format looks like.

[your sourcetype]
SHOULD_LINEMERGE = true
BREAK_ONLY_BEFORE = <LOG>
TIME_PREFIX = <DATE>
TIME_FORMAT = %d%m%Y</DATE>%n<TIME>%H%M%S

View solution in original post

maciep
Champion

You'll need to configure props.conf at the parsing layer (probably on your indexer) appropriately. That includes creating a new stanza for your sourcetype and telling Splunk how to deal with the format.

http://docs.splunk.com/Documentation/Splunk/latest/admin/Propsconf

http://pubs.opengroup.org/onlinepubs/009695399/functions/strptime.html

Something like this should work. Tell splunk to merge multiple lines into one event and where to break events. Then tell it where the timestamp is and what the format looks like.

[your sourcetype]
SHOULD_LINEMERGE = true
BREAK_ONLY_BEFORE = <LOG>
TIME_PREFIX = <DATE>
TIME_FORMAT = %d%m%Y</DATE>%n<TIME>%H%M%S
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Enhance Security Operations with Automated Threat Analysis in the Splunk EcosystemAre you leveraging ...

What Is Splunk? Here’s What You Can Do with Splunk

Hey Splunk Community, we know you know Splunk. You likely leverage its unparalleled ability to ingest, index, ...

Level Up Your .conf25: Splunk Arcade Comes to Boston

With .conf25 right around the corner in Boston, there’s a lot to look forward to — inspiring keynotes, ...