<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Duplicated Events: Local Log4net_xml Monitor in Getting Data In</title>
    <link>https://community.splunk.com/t5/Getting-Data-In/Duplicated-Events-Local-Log4net-xml-Monitor/m-p/511355#M86856</link>
    <description>&lt;P&gt;I've got an issue where a significant portion of my ingested Log4Net_xml sourcetype logs have duplicate events. I'm currently using a file monitor on a Ubuntu 16.04 LTS, Splunk 7.3.0 machine with a local Monitor stanza to ingest the logs which looks like this:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;[monitor:///mnt/CALogs/.../*.log]
disabled = 0
host_segment = 4
index = ca
sourcetype = log4net_xml
#initCrcLength = 1024 # Tried this, it started reindexing all the log file.&lt;/LI-CODE&gt;&lt;P&gt;Our Log4Net configs looks like this:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;&amp;lt;appender name="RollingFile" type="log4net.Appender.RollingFileAppender"&amp;gt;
               &amp;lt;file type="log4net.Util.PatternString" value="\\server1\ca\Logs\Application\%property{log4net:HostName}\Application.log" /&amp;gt;
               &amp;lt;appendToFile value="true" /&amp;gt;
               &amp;lt;rollingStyle value="Size" /&amp;gt;
               &amp;lt;maximumFileSize value="5MB" /&amp;gt;
               &amp;lt;staticLogFileName value="true" /&amp;gt;
               &amp;lt;maxSizeRollBackups value="10" /&amp;gt;
               &amp;lt;layout type="log4net.Layout.XMLLayout" /&amp;gt;
          &amp;lt;/appender&amp;gt;&lt;/LI-CODE&gt;&lt;P&gt;I have that directory mounted over SMB/CIFS with the following entry in fstab:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;//server1/LogsCA /mnt/CALogs cifs username=user,password=Password,domain=somedomain.dev,sec=ntlm 0 0&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Can anybody spot what I'm doing wrong?&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Here's a picture of the search that I'm using to estimate duplicates:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JacobCarrell_0-1595945517609.png" style="width: 745px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/9911i37EA50DA9ECCA178/image-dimensions/745x473?v=v2" width="745" height="473" role="button" title="JacobCarrell_0-1595945517609.png" alt="JacobCarrell_0-1595945517609.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Tue, 28 Jul 2020 14:21:35 GMT</pubDate>
    <dc:creator>JacobCarrell</dc:creator>
    <dc:date>2020-07-28T14:21:35Z</dc:date>
    <item>
      <title>Duplicated Events: Local Log4net_xml Monitor</title>
      <link>https://community.splunk.com/t5/Getting-Data-In/Duplicated-Events-Local-Log4net-xml-Monitor/m-p/511355#M86856</link>
      <description>&lt;P&gt;I've got an issue where a significant portion of my ingested Log4Net_xml sourcetype logs have duplicate events. I'm currently using a file monitor on a Ubuntu 16.04 LTS, Splunk 7.3.0 machine with a local Monitor stanza to ingest the logs which looks like this:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;[monitor:///mnt/CALogs/.../*.log]
disabled = 0
host_segment = 4
index = ca
sourcetype = log4net_xml
#initCrcLength = 1024 # Tried this, it started reindexing all the log file.&lt;/LI-CODE&gt;&lt;P&gt;Our Log4Net configs looks like this:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;&amp;lt;appender name="RollingFile" type="log4net.Appender.RollingFileAppender"&amp;gt;
               &amp;lt;file type="log4net.Util.PatternString" value="\\server1\ca\Logs\Application\%property{log4net:HostName}\Application.log" /&amp;gt;
               &amp;lt;appendToFile value="true" /&amp;gt;
               &amp;lt;rollingStyle value="Size" /&amp;gt;
               &amp;lt;maximumFileSize value="5MB" /&amp;gt;
               &amp;lt;staticLogFileName value="true" /&amp;gt;
               &amp;lt;maxSizeRollBackups value="10" /&amp;gt;
               &amp;lt;layout type="log4net.Layout.XMLLayout" /&amp;gt;
          &amp;lt;/appender&amp;gt;&lt;/LI-CODE&gt;&lt;P&gt;I have that directory mounted over SMB/CIFS with the following entry in fstab:&lt;/P&gt;&lt;LI-CODE lang="markup"&gt;//server1/LogsCA /mnt/CALogs cifs username=user,password=Password,domain=somedomain.dev,sec=ntlm 0 0&lt;/LI-CODE&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Can anybody spot what I'm doing wrong?&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Here's a picture of the search that I'm using to estimate duplicates:&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="JacobCarrell_0-1595945517609.png" style="width: 745px;"&gt;&lt;img src="https://community.splunk.com/t5/image/serverpage/image-id/9911i37EA50DA9ECCA178/image-dimensions/745x473?v=v2" width="745" height="473" role="button" title="JacobCarrell_0-1595945517609.png" alt="JacobCarrell_0-1595945517609.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Tue, 28 Jul 2020 14:21:35 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Getting-Data-In/Duplicated-Events-Local-Log4net-xml-Monitor/m-p/511355#M86856</guid>
      <dc:creator>JacobCarrell</dc:creator>
      <dc:date>2020-07-28T14:21:35Z</dc:date>
    </item>
  </channel>
</rss>

