<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Issue filtering specific logs on UF in Getting Data In</title>
    <link>https://community.splunk.com/t5/Getting-Data-In/Issue-filtering-specific-logs-on-UF/m-p/487520#M83464</link>
    <description>&lt;P&gt;Hi,&lt;/P&gt;

&lt;P&gt;I have recently started building apps on splunk. I am monitoring a log file on the UF , containing logs from various applications and trying to fetch specific alert logs from a containing "VERITAS-COMMAND-CENTRAL-MIB". Below are the files I have configured for the the requirement.  Issue is, &lt;STRONG&gt;the logs are getting tagged to a different source type(snmptrapd) instead of the intended one (st_netbackup)&lt;/STRONG&gt; .  Both my enterprise and UF are on 7.1.4 version.&lt;/P&gt;

&lt;H3&gt;inputs.conf&lt;/H3&gt;

&lt;P&gt;[monitor:///var/log/snmptrapd.log]&lt;BR /&gt;
disabled = 0&lt;BR /&gt;
index = acn_backup_netbackup_tier1_idx&lt;/P&gt;

&lt;H1&gt;index = main&lt;/H1&gt;

&lt;P&gt;host = XX.XX.XX.XX&lt;/P&gt;

&lt;H3&gt;System level outputs.con&lt;/H3&gt;

&lt;P&gt;[tcpout:acn-dev1-route-group]&lt;BR /&gt;
server = xx.xx.xx.xx:9997&lt;/P&gt;

&lt;H3&gt;props.conf&lt;/H3&gt;

&lt;P&gt;[source::/var/log/snmptrapd.log]&lt;BR /&gt;
description = Netbackup log file&lt;BR /&gt;
TRANSFORMS-set = removeNETSNMPHeader,removeOther&lt;BR /&gt;
TRANSFORMS-route = parseNetbackup&lt;BR /&gt;
SEDCMD-community = s/community (\w+)/community *****/g&lt;BR /&gt;
BREAK_ONLY_BEFORE = \d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}&lt;BR /&gt;
TIME_FORMAT = %Y-%m-%d %T&lt;BR /&gt;
TRANSFORMS-customsourcetype = st_netbackup&lt;/P&gt;

&lt;H3&gt;transforms.conf&lt;/H3&gt;

&lt;P&gt;[st_netbackup]&lt;BR /&gt;
REGEX = (!?)VERITAS-COMMAND-CENTRAL-MIB&lt;BR /&gt;
DEST_KEY = MetaData:Sourcetype&lt;BR /&gt;
FORMAT = st_netbackup&lt;/P&gt;

&lt;P&gt;[removeNETSNMPHeader]&lt;BR /&gt;
REGEX =NET-SNMP version*&lt;BR /&gt;
DEST_KEY = queue&lt;BR /&gt;
FORMAT = nullQueue&lt;/P&gt;

&lt;P&gt;[removeOther]&lt;BR /&gt;
REGEX = (.)&lt;BR /&gt;
DEST_KEY = queue&lt;BR /&gt;
FORMAT = nullQueue&lt;/P&gt;

&lt;P&gt;[parseNetbackup]&lt;BR /&gt;
REGEX = (!?)VERITAS-COMMAND-CENTRAL-MIB&lt;BR /&gt;
DEST_KEY = _TCP_ROUTING&lt;BR /&gt;
FORMAT = acn-dev1-route-group&lt;/P&gt;

&lt;P&gt;Below is the log format as received on the desired index. It would be great to hear any suggestions here.&lt;BR /&gt;
&lt;EM&gt;2020-01-14 04:15:27 ip-xx.xx.xx.xx.ec2.internal [UDP: [xx.xx.xx.xx]:53318-&amp;gt;[xx.xx.xx.xx]:162]:&lt;BR /&gt;
DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (753481) 2:05:34.81    SNMPv2-MIB::snmpTrapOID.0 = OID: VERITAS-COMMAND-CENTRAL-MIB::ccError   VERITAS-COMMAND-CENTRAL-MIB::alertRecipients = STRING: Splunk Dev    VERITAS-COMMAND-CENTRAL-MIB::alertSummary = STRING: 27 Clear Connections To Media Server ec2amaz-akg3cqb Lost  VERITAS-COMMAND-CENTRAL-MIB::alertDescription = STRING: Lost contact with media server    VERITAS-COMMAND-CENTRAL-MIB::policyName = STRING: Lost Contact with Media Server      VERITAS-COMMAND-CENTRAL-MIB::objectType = STRING:    VERITAS-COMMAND-CENTRAL-MIB::collectorName = STRING:    VERITAS-COMMAND-CENTRAL-MIB::ccHost = STRING: EC2AMAZ-AKG3CQB   VERITAS-COMMAND-CENTRAL-MIB::sourceId = STRING: EC2AMAZ-AKG3CQB VERITAS-COMMAND-CENTRAL-MIB::ccObject = STRING:      VERITAS-COMMAND-CENTRAL-MIB::sampleData = STRING:       VERITAS-COMMAND-CENTRAL-MIB::ccAlertSeverity = STRING: Major    VERITAS-COMMAND-CENTRAL-MIB::ccAlertTime = STRING: Tue Jan 14 04:15:27 UTC 2020&lt;BR /&gt;
host =xx.xx.xx.xxsource = /var/log/snmptrapd.logsourcetype = snmptrapd&lt;/EM&gt;&lt;/P&gt;</description>
    <pubDate>Wed, 30 Sep 2020 03:43:52 GMT</pubDate>
    <dc:creator>tirthasplunk</dc:creator>
    <dc:date>2020-09-30T03:43:52Z</dc:date>
    <item>
      <title>Issue filtering specific logs on UF</title>
      <link>https://community.splunk.com/t5/Getting-Data-In/Issue-filtering-specific-logs-on-UF/m-p/487520#M83464</link>
      <description>&lt;P&gt;Hi,&lt;/P&gt;

&lt;P&gt;I have recently started building apps on splunk. I am monitoring a log file on the UF , containing logs from various applications and trying to fetch specific alert logs from a containing "VERITAS-COMMAND-CENTRAL-MIB". Below are the files I have configured for the the requirement.  Issue is, &lt;STRONG&gt;the logs are getting tagged to a different source type(snmptrapd) instead of the intended one (st_netbackup)&lt;/STRONG&gt; .  Both my enterprise and UF are on 7.1.4 version.&lt;/P&gt;

&lt;H3&gt;inputs.conf&lt;/H3&gt;

&lt;P&gt;[monitor:///var/log/snmptrapd.log]&lt;BR /&gt;
disabled = 0&lt;BR /&gt;
index = acn_backup_netbackup_tier1_idx&lt;/P&gt;

&lt;H1&gt;index = main&lt;/H1&gt;

&lt;P&gt;host = XX.XX.XX.XX&lt;/P&gt;

&lt;H3&gt;System level outputs.con&lt;/H3&gt;

&lt;P&gt;[tcpout:acn-dev1-route-group]&lt;BR /&gt;
server = xx.xx.xx.xx:9997&lt;/P&gt;

&lt;H3&gt;props.conf&lt;/H3&gt;

&lt;P&gt;[source::/var/log/snmptrapd.log]&lt;BR /&gt;
description = Netbackup log file&lt;BR /&gt;
TRANSFORMS-set = removeNETSNMPHeader,removeOther&lt;BR /&gt;
TRANSFORMS-route = parseNetbackup&lt;BR /&gt;
SEDCMD-community = s/community (\w+)/community *****/g&lt;BR /&gt;
BREAK_ONLY_BEFORE = \d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}&lt;BR /&gt;
TIME_FORMAT = %Y-%m-%d %T&lt;BR /&gt;
TRANSFORMS-customsourcetype = st_netbackup&lt;/P&gt;

&lt;H3&gt;transforms.conf&lt;/H3&gt;

&lt;P&gt;[st_netbackup]&lt;BR /&gt;
REGEX = (!?)VERITAS-COMMAND-CENTRAL-MIB&lt;BR /&gt;
DEST_KEY = MetaData:Sourcetype&lt;BR /&gt;
FORMAT = st_netbackup&lt;/P&gt;

&lt;P&gt;[removeNETSNMPHeader]&lt;BR /&gt;
REGEX =NET-SNMP version*&lt;BR /&gt;
DEST_KEY = queue&lt;BR /&gt;
FORMAT = nullQueue&lt;/P&gt;

&lt;P&gt;[removeOther]&lt;BR /&gt;
REGEX = (.)&lt;BR /&gt;
DEST_KEY = queue&lt;BR /&gt;
FORMAT = nullQueue&lt;/P&gt;

&lt;P&gt;[parseNetbackup]&lt;BR /&gt;
REGEX = (!?)VERITAS-COMMAND-CENTRAL-MIB&lt;BR /&gt;
DEST_KEY = _TCP_ROUTING&lt;BR /&gt;
FORMAT = acn-dev1-route-group&lt;/P&gt;

&lt;P&gt;Below is the log format as received on the desired index. It would be great to hear any suggestions here.&lt;BR /&gt;
&lt;EM&gt;2020-01-14 04:15:27 ip-xx.xx.xx.xx.ec2.internal [UDP: [xx.xx.xx.xx]:53318-&amp;gt;[xx.xx.xx.xx]:162]:&lt;BR /&gt;
DISMAN-EVENT-MIB::sysUpTimeInstance = Timeticks: (753481) 2:05:34.81    SNMPv2-MIB::snmpTrapOID.0 = OID: VERITAS-COMMAND-CENTRAL-MIB::ccError   VERITAS-COMMAND-CENTRAL-MIB::alertRecipients = STRING: Splunk Dev    VERITAS-COMMAND-CENTRAL-MIB::alertSummary = STRING: 27 Clear Connections To Media Server ec2amaz-akg3cqb Lost  VERITAS-COMMAND-CENTRAL-MIB::alertDescription = STRING: Lost contact with media server    VERITAS-COMMAND-CENTRAL-MIB::policyName = STRING: Lost Contact with Media Server      VERITAS-COMMAND-CENTRAL-MIB::objectType = STRING:    VERITAS-COMMAND-CENTRAL-MIB::collectorName = STRING:    VERITAS-COMMAND-CENTRAL-MIB::ccHost = STRING: EC2AMAZ-AKG3CQB   VERITAS-COMMAND-CENTRAL-MIB::sourceId = STRING: EC2AMAZ-AKG3CQB VERITAS-COMMAND-CENTRAL-MIB::ccObject = STRING:      VERITAS-COMMAND-CENTRAL-MIB::sampleData = STRING:       VERITAS-COMMAND-CENTRAL-MIB::ccAlertSeverity = STRING: Major    VERITAS-COMMAND-CENTRAL-MIB::ccAlertTime = STRING: Tue Jan 14 04:15:27 UTC 2020&lt;BR /&gt;
host =xx.xx.xx.xxsource = /var/log/snmptrapd.logsourcetype = snmptrapd&lt;/EM&gt;&lt;/P&gt;</description>
      <pubDate>Wed, 30 Sep 2020 03:43:52 GMT</pubDate>
      <guid>https://community.splunk.com/t5/Getting-Data-In/Issue-filtering-specific-logs-on-UF/m-p/487520#M83464</guid>
      <dc:creator>tirthasplunk</dc:creator>
      <dc:date>2020-09-30T03:43:52Z</dc:date>
    </item>
  </channel>
</rss>

