topic Problem routing events to nullQueue in Getting Data In

Problem routing events to nullQueue

nocostk — Thu, 25 Nov 2010 04:13:26 GMT

I'm trying to get a multi-line log4j event sent to the nullQueue on a Regular forwarder. Here is my inputs/props/transforms.conf:

[monitor:///opt/ShoppingSite/work/logs/tomcat.log]
disabled = false
followTail = 1
sourcetype = log4j

[source::///opt/ShoppingSite/work/logs/tomcat.log]
TRANSFORMS-filtercrap = cleantomcat

[cleantomcat]
REGEX = (?m).+getResponseEntity\nINFO:\s+The\slength\sof\sthe\smessage\sbody\sis\sunknown.+
DEST_KEY = queue
FORMAT = nullQueue

This is the event from my tomcat log I need filtered:

Nov 24, 2010 12:51:18 PM com.noelios.restlet.http.HttpClientCall getResponseEntity
INFO: The length of the message body is unknown. The entity must be handled carefully and consumed entirely in order to surely release the connection.

I've checked my regex using KiKi (Linux regex utility). Anyone have any thoughts? These events are still showing up when I search on my search head.

Re: Problem routing events to nullQueue

bfaber — Thu, 25 Nov 2010 11:04:48 GMT

What happens if you change the props.conf from

[source::///opt/ShoppingSite/work/logs/tomcat.log]

[log4j]

and restart the forwarder?

Re: Problem routing events to nullQueue

nocostk — Fri, 26 Nov 2010 21:24:48 GMT

That seems to work. Why would sourcetype work but not source?

Re: Problem routing events to nullQueue

gkanapathy — Tue, 30 Nov 2010 10:24:18 GMT

source:: clauses should not have the triple slashes /// at the start, just the /. The // is part of inputs monitor syntax.