I have the following syslog data and I need help extracting the timestamp field at the end of the event:
Sep 6 06:07:20 2016-09-06 06: 07:20,165 192.168.0.0 CPPM_Dashboard_Summary 17000 1 0 session_id=A00001234-01-56bcde1f,req_source=RADIUS,user_name=XXXXXXXXXX,service_name=ABC802.1X,alerts_present=0,nas_ip=192.168.1.1,nas_port=0,conn_status=Unknown,login_status=ACCEPT,error_code=0,mac_address=12a3123456n2,timestamp=2016-09-06 06:05:48-07,write_timestamp=2016-09-06 06:05:50.133529-07
Sep 6 14:24:18 2016-09-06 14: 24:18,179 192.168.109.102 CPPM_System_Stat 11115 1 0 id=11112,swap_size_used=65757,slash_size_used=11166596,swap_memory_avail=6079780,system_memory_avail=3737736,cpu_raw_user=1,cpu_raw_nice=0,cpu_raw_system=13,cpu_raw_idle=87,mgmt_inf_status=up,data_inf_status=down,uptime=8291850,timestamp=2016-09-06 14:24:07.156076-07
I'm using the following props on the indexers and heavy forwarder, but the timestamp is still not parsing out:
TIME_PREFIX = ,timestamp
TIME_FORMAT = %Y-%d-%m %H:%M:%S.%6N
MAX_TIMESTAMP_LOOKAHEAD = 350
Yout time prefix should be
,timestamp=
And your lookahead should be 26 the exact characters number of your timestamp.
Bye.
Giuseppe
if you're satisfied of the answer, please, accept the answer.
Bye.
Giuseppe
Try this in your props on your indexer and restart the service. This will only affect new data. Since you have a TIME_PREFIX
, the look ahead will start from the point it finds a prefix match.
TIME_PREFIX = timestamp=
TIME_FORMAT = %Y-%d-%m %H:%M:%S.%6N
MAX_TIMESTAMP_LOOKAHEAD = 30
Your solution did not seem to work. Any other suggestions?
I just tried this, and it worked. Are you trying it datapreview? Is your props on the right server and has right stanza?
SHOULD_LINEMERGE=true
TIME_FORMAT=%Y-%d-%m %H:%M:%S.%6N
TIME_PREFIX=timestamp=
MAX_TIMESTAMP_LOOKAHEAD=30