<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Why is my nullQueue configuration in inputs.conf and transforms.conf not working? in Getting Data In</title>
    <link>https://community.splunk.com/t5/Getting-Data-In/Why-is-my-nullQueue-configuration-in-inputs-conf-and-transforms/m-p/217022#M42706</link>
    <description>&lt;P&gt;Hello Splunkers!&lt;/P&gt;

&lt;P&gt;I am having difficulties with my nullQueue configuration when trying to exclude rows with JS, CSS, and images. &lt;BR /&gt;
Trying the regex in the Splunk search works fine, but the events are still indexed by Splunk.&lt;BR /&gt;
My setup is a single Splunk instance and the conf files are in /etc/system/local.&lt;/P&gt;

&lt;P&gt;Inputs.conf&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;[monitor://C:\Users\admin\Desktop\test.log]
disabled = false
host = bla
sourcetype = Transform_Test
TRANSFORMS-null= setnull
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;Transforms.conf&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;[setnull]
REGEX = (?m)^.*(gif|css|js|jpg|png|ico)\s.*$
DEST_KEY = queue
FORMAT = nullQueue
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;What to exclude:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;192.168.1.3 - - [09/Sep/2015:09:35:46 +0200] "GET /work/js/abc.js HTTP/1.1" 200 41162 392
192.168.1.3 - - [09/Sep/2015:09:35:46 +0200] "GET /work/images/test.gif HTTP/1.0" 200 135 20
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;What to include:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;192.168.1.3 - - [09/Sep/2015:09:35:44 +0200] "POST /bla/abc.jsp?target=layout!ba!searchForm&amp;amp;eventName=Search HTTP/1.1" 200 184359 1832621
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;When changing the regex to &lt;CODE&gt;\[sshd\]&lt;/CODE&gt; and make an event &lt;CODE&gt;[sshd]&lt;/CODE&gt; in the logfile, the event isn't excluded as well. So it doesn't look like an problem with the regex.&lt;/P&gt;

&lt;P&gt;Does someone have any idea?&lt;/P&gt;</description>
    <pubDate>Wed, 09 Sep 2015 10:00:03 GMT</pubDate>
    <dc:creator>BBakkenes</dc:creator>
    <dc:date>2015-09-09T10:00:03Z</dc:date>
    <item>
      <title>Why is my nullQueue configuration in inputs.conf and transforms.conf not working?</title>
      <link>https://community.splunk.com/t5/Getting-Data-In/Why-is-my-nullQueue-configuration-in-inputs-conf-and-transforms/m-p/217022#M42706</link>
      <description>&lt;P&gt;Hello Splunkers!&lt;/P&gt;

&lt;P&gt;I am having difficulties with my nullQueue configuration when trying to exclude rows with JS, CSS, and images. &lt;BR /&gt;
Trying the regex in the Splunk search works fine, but the events are still indexed by Splunk.&lt;BR /&gt;
My setup is a single Splunk instance and the conf files are in /etc/system/local.&lt;/P&gt;

&lt;P&gt;Inputs.conf&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;[monitor://C:\Users\admin\Desktop\test.log]
disabled = false
host = bla
sourcetype = Transform_Test
TRANSFORMS-null= setnull
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;Transforms.conf&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;[setnull]
REGEX = (?m)^.*(gif|css|js|jpg|png|ico)\s.*$
DEST_KEY = queue
FORMAT = nullQueue
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;What to exclude:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;192.168.1.3 - - [09/Sep/2015:09:35:46 +0200] "GET /work/js/abc.js HTTP/1.1" 200 41162 392
192.168.1.3 - - [09/Sep/2015:09:35:46 +0200] "GET /work/images/test.gif HTTP/1.0" 200 135 20
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;What to include:&lt;/P&gt;

&lt;PRE&gt;&lt;CODE&gt;192.168.1.3 - - [09/Sep/2015:09:35:44 +0200] "POST /bla/abc.jsp?target=layout!ba!searchForm&amp;amp;eventName=Search HTTP/1.1" 200 184359 1832621
&lt;/CODE&gt;&lt;/PRE&gt;

&lt;P&gt;When changing the regex to &lt;CODE&gt;\[sshd\]&lt;/CODE&gt; and make an event &lt;CODE&gt;[sshd]&lt;/CODE&gt; in the logfile, the event isn't excluded as well. So it doesn't look like an problem with the regex.&lt;/P&gt;

&lt;P&gt;Does someone have any idea?&lt;/P&gt;</description>
      <pubDate>Wed, 09 Sep 2015 10:00:03 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Getting-Data-In/Why-is-my-nullQueue-configuration-in-inputs-conf-and-transforms/m-p/217022#M42706</guid>
      <dc:creator>BBakkenes</dc:creator>
      <dc:date>2015-09-09T10:00:03Z</dc:date>
    </item>
    <item>
      <title>Re: Why is my nullQueue configuration in inputs.conf and transforms.conf not working?</title>
      <link>https://community.splunk.com/t5/Getting-Data-In/Why-is-my-nullQueue-configuration-in-inputs-conf-and-transforms/m-p/217023#M42707</link>
      <description>&lt;P&gt;You don't use inputs.conf files to call transforms. You need to have a props.conf file. So, in your props.conf file you would have something to the affect of:&lt;/P&gt;

&lt;P&gt;[Transform_Test]&lt;BR /&gt;
 TRANSFORMS-null= setnull&lt;/P&gt;

&lt;P&gt;then you can leave your transforms.conf file the way it is.&lt;/P&gt;</description>
      <pubDate>Wed, 09 Sep 2015 12:56:06 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Getting-Data-In/Why-is-my-nullQueue-configuration-in-inputs-conf-and-transforms/m-p/217023#M42707</guid>
      <dc:creator>tskinnerivsec</dc:creator>
      <dc:date>2015-09-09T12:56:06Z</dc:date>
    </item>
  </channel>
</rss>

