Getting Data In

Different timestamps from same source (udp syslog) and host

Explorer

I have a host that is sending syslog entries with a couple of different formats. I have resolved how to roll multiline inputs into a single event, however, it has caused a problem with timestamp extraction on some subsequent events with a different format. Here are some example inputs from the same host:

Aug 5 14:09:57 1.2.3.4 Aug 5 14:03:26 hostname CSCOacsTACACSAccounting 0000053283 2 0 2011-08-05 14:03:26.411 -08:00 0000160939 3301 NOTICE Tacacs-Accounting: TACACS+ Accounting START, ACSVersion=acs-5.1.0.44-B.2347, ConfigVersionId=3, Device IP Address=4.3.2.1, RequestLatency=1, NetworkDeviceName=HOSTNAME2911, Type=Accounting, Privilege-Level=1, Service=None, Authen-Method=NotSet, AVPair=taskid=1, AVPair=timezone=PST, AVPair=event=sysacct, AVPair=reason=reload, AVPair=reload-reason=power-on, AVPair=ios-version=Cisco IOS Software\, C2900 Software (C2900-UNIVERSALK9-M)\, Version 15.0(1)M3\, RELEASE SOFTWARE (fc2)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2010 by Cisco Systems\, Inc.
Compiled Thu 04-Aug-11 16:33 by mtillu, AcctRequest-Flags=Start, Service-Argument=system, AcsSessionID=ldbpcicacs/102307938/506, SelectedAccessService=Store
2911, Step=13006 , Step=15008 , Step=15006 , Step=15012 , Step=13035 , NetworkDeviceGroups=Location:All Locations:Store ISRs,

I have used the following in \etc\system\local\props.conf

[host::1.2.3.4]
LINEBREAKER = ([\r\n]+(?=\w{3}\s+\d{1,2}\s+\d{2}:\d{2}:\d{2}|Compiled))
SHOULD
LINEMERGE = false
TIMEPREFIX = ^
TIME
FORMAT = %h %e %H:%M:%S
MAXTIMESTAMPLOOKAHEAD = 2

This works, however, the time is no longer being extracted properly from the last event listed. If I remove the TIMEPREFIX, TIMEFORMAT and MAXTIMESTAMPLOOKAHEAD, things seem to work. However, those entries were recommended by Splunk Support and I wonder how necessary they are. Is there a way to help with the extraction given the different formats or should I just leave the time related functions out of props.conf?

1 Solution

Explorer

Got a response that handling multiple timestamp types can be done with a combination of the condition in the LINEBREAKER and a TIMEFORMAT=\etc\system\local\custom_datetime.xml definition.

View solution in original post

0 Karma

Explorer

Got a response that handling multiple timestamp types can be done with a combination of the condition in the LINEBREAKER and a TIMEFORMAT=\etc\system\local\custom_datetime.xml definition.

View solution in original post

0 Karma