Hi.
I'm indexing the log from the Service-now MID-Server, that should be nice and easy, most lines start with a timestamp, and a few are multiline events.
04/10/19 11:50:24 (365) LogStatusMonitor.60 stats threads: 67, memory max: 910.0mb, allocated: 402.0mb, used: 29.0mb, standard.queued: 0 probes, standard.processing: 0 probes, expedited.queued: 0 probes, expedited.processing: 0 probes, interactive.queued: 0 probes, interactive.processing: 0 probes
04/10/19 11:51:24 (373) LogStatusMonitor.60 stats threads: 67, memory max: 910.0mb, allocated: 402.0mb, used: 29.0mb, standard.queued: 0 probes, standard.processing: 0 probes, expedited.queued: 0 probes, expedited.processing: 0 probes, interactive.queued: 0 probes, interactive.processing: 0 probes
04/10/19 11:52:24 (406) LogStatusMonitor.60 stats threads: 67, memory max: 910.0mb, allocated: 402.0mb, used: 30.0mb, standard.queued: 0 probes, standard.processing: 0 probes, expedited.queued: 0 probes, expedited.processing: 0 probes, interactive.queued: 0 probes, interactive.processing: 0 probes
04/10/19 11:52:45 (197) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Worker starting: JDBCProbe source: 7f753a46db16a740c53f6c16ca9619a9
04/10/19 11:52:45 (275) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Waiting for connection semaphore
04/10/19 11:52:45 (275) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Obtained connection semaphore
04/10/19 11:52:45 (275) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af SELECT DISTINCT pco.PCO_Ref, pco.Act_Plan, pco.Description, pco.Impact, pco.Prioritet, pco.risk, pco.Txt_type, convert(varchar(MAX), pco.Txt) as Txt, pco.Urgency, status.CloseType, status.PCOClose, status.PCOPlan2, status.PCOrelease3, act.SenesteStart, act.SenesteEnd
FROM "PobPco"."dbo"."PCO" pco
join "PobPco"."dbo"."PCO_status" status on pco.PCO_Ref = status.PCO_Ref
FULL outer join "PobPco"."dbo"."Act" act on pco.PCO_Ref = act.PCO_Ref and (act.Sequence='430' OR act.Sequence='491')
WHERE (pco.Act_Plan='LEV_UDK_LEVERANCESITE' OR pco.Act_Plan='APPL_TWS_INITIERET' OR pco.Act_Plan='TEK_GENEREL_WEB')
04/10/19 11:53:24 (392) LogStatusMonitor.60 stats threads: 67, memory max: 910.0mb, allocated: 402.0mb, used: 30.0mb, standard.queued: 0 probes, standard.processing: 1 probes, expedited.queued: 0 probes, expedited.processing: 0 probes, interactive.queued: 0 probes, interactive.processing: 0 probes
On the universal forwarder, there's just an input.conf, that sets sourcetype and index.
On the indexer I have a props.conf with this content:
[snow:mid]
SHOULD_LINEMERGE = true
NO_BINARY_CHECK = true
CHARSET = AUTO
disabled = false
TIME_FORMAT = %m/%d/%y %H:%M:%S
category = Custom
My problem is that for some reason Splunk doesn't do event break correctly
10/04/2019
11:53:24.000
04/10/19 11:53:38 (565) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf050000001.xml
04/10/19 11:53:38 (596) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf140000001.xml
04/10/19 11:53:38 (611) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf240000001.xml
04/10/19 11:53:38 (627) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf430000001.xml
04/10/19 11:53:38 (643) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf530000001.xml
04/10/19 11:53:38 (643) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Enqueuing: D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\work\monitors\ECCSender\output_s\ecc_queue.16a06aacf530000002.xml
04/10/19 11:53:38 (643) Worker-Standard:JDBCProbe-69923714db3cf300e6067742399619af Worker completed: JDBCProbe source: 7f753a46db16a740c53f6c16ca9619a9 time: 0:00:53.368
04/10/19 11:53:38 (880) ECCSender.1 Sending ecc_queue.16a06aacf050000001.xml
04/10/19 11:53:38 (989) ECCSender.1 Sending ecc_queue.16a06aacf140000001.xml
04/10/19 11:53:39 (098) ECCSender.1 Sending ecc_queue.16a06aacf240000001.xml
04/10/19 11:53:39 (192) ECCSender.1 Sending ecc_queue.16a06aacf430000001.xml
04/10/19 11:53:39 (270) ECCSender.1 Sending ecc_queue.16a06aacf530000001.xml
04/10/19 11:53:39 (364) ECCSender.1 Sending ecc_queue.16a06aacf530000002.xml
Collapse
host = ATP-34UMID02 source = D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\logs\agent0.log.0 sourcetype = snow:mid
10/04/2019
11:53:24.000
04/10/19 11:53:24 (392) LogStatusMonitor.60 stats threads: 67, memory max: 910.0mb, allocated: 402.0mb, used: 30.0mb, standard.queued: 0 probes, standard.processing: 1 probes, expedited.queued: 0 probes, expedited.processing: 0 probes, interactive.queued: 0 probes, interactive.processing: 0 probes
host = ATP-34UMID02 source = D:\ServiceNow\MID_Server\atp-34umid02_dev01\agent\logs\agent0.log.0 sourcetype = snow:mid
... View more